



Abstract 


As technology in digital hardware advances, commensurate advances in the 
performance of digital compensators will be expected to follow. To meet these 
performance demands, engineers are resorting to complex design configurations that 
include multiple sensors and control effectors. For such a system, to obtain the best 
performance at a fixed level of real-time computation load, it is often necessary to 
sample the signals for the various sensors and control effectors at different rates. 
Surprisingly, methods for synthesizing digital compensators are well-developed only 
for the special case where all sampling rates are the same. 

The successive loop closures synthesis method is the only method for multirate 
(MR) synthesis in common use. It is an ad-hoc method in that cross-coupling effects 
between control loops are dealt with as cross-loop disturbances. 

For single-rate (SR) systems, algorithms that solve for steady-state optimal 
quadratic regulators and steady-state Kalman estimators are popular for 
synthesizing multivariable compensators. Recently, extensions of these algorithms 
have been developed that handle MR sampling policies. A disadvantage of this 
method is that the optimal compensators tend to be unnecessarily complex. 

A new method for MR synthesis is introduced in this work. It requires a 
gradient-search solution to a constrained optimization problem. Some advantages 
of this method are that the control laws for all control loops are synthesized 
simultaneously, taking full advantage of all cross-coupling effects (which is the 
principal advantage of the optimal control law synthesis method), and that simple, 
low-order compensator structures are easily accommodated (which is the principal 
advantage of the successive loop closures synthesis method). An algorithm and an 
associated computer program for solving the constrained optimization problem are 
described. 
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The successive loop closures, optimal control, and constrained optimization 
synthesis methods are applied to two example design problems. A series of 
compensator pairs are synthesized for each example problem. Each pair consists 
of one MR compensator and one SR compensator that are designed to satisfy the 
same performance objectives with sampling rates such that the computation loads 
for their real-time operation are the same. Except for cases involving very fast 
sampling rates compared to the characteristic frequencies of the desired closed- 
loop poles, the MR compensators are shown to consistently out-perform their SR 
counterparts. 

The successive loop closures, optimal control, and constrained optimization 
synthesis methods are compared, in the context of the two example design problems. 
For the mass-spring-mass problem, where good rejection of random disturbances is 
the performance objective, the successive loop closures synthesis method is shown 
to be ideal. For the two link robot arm problem, the constrained optimization 
synthesis method is shown to be a good method for synthesizing a second-order 
compensator to control the tip position. 

For the two link robot arm problem, an optimal MR compensator provides the 
best responses to tip positioning commands in terms of speed and overshoot. But 
this compensator is periodically time varying and consequently the computation 
load for its real-time operation is high. It is shown that such periodicity is not 
a prerequisite for good performance. A time-invariant MR compensator with 
virtually identical performance characteristics is synthesized using the constrained 
optimization synthesis method. 
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Chapter 1 
Introduction 


This chapter contains four sections. Section 1.1 discusses the motivation for this 
research. Section 1.2 is a summary of related works from the literature. Section 1.3 
is an outline of the thesis. Section 1.4 lists the principal contributions of this 
research. 

§1.1 Purpose. As technology in digital hardware advances, commensurate 
advances in the performance of digital compensators will be expected to follow. 
To meet these performance demands, engineers are resorting to complex design 
configurations that include multiple sensors and control effectors. For such a system, 
to obtain the best performance at a fixed level of real-time computation load, it is 
often necessary to sample the signals for the various sensors and control effectors 
at different rates. Surprisingly, methods for synthesizing digital compensators are 
well-developed only for the special case where all sampling rates are the same. 

The purpose of this research was to develop new understanding in the area 
of multirate (MR) synthesis. In this document, we consider three methods for MR 
synthesis: (1) the successive loop closures synthesis method; (2) the optimal control 
law synthesis method; and (3) the constrained optimization synthesis method. 
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1. Introduction 


The one-loop-at-a-time successive loop closures synthesis method is virtually 
the only method for MR synthesis in co mm on use. It is an ad-hoc method 
in that cross-coupling effects between control loops are dealt with as cross-loop 
disturbances. 

An advantage of the optimal control law synthesis method is that the control 
laws for all control loops axe synthesized simultaneously, taiing full advantage 
of all cross coupling effects. A disadvantage of this method is that the optimal 
compensators tend to be unnecessarily complex. 

The constrained optimization synthesis method is a new method that we 
developed as part of this research. It requires a gradient-search solution to 
a constrained optimzation problem. Some advantages of this method are that 
the control laws for all control loops are synthesized simultaneously, taking full 
advantage of all cross-coupling effects (which is the principal advantage of the 
optimal control law synthesis method), and that simple, low-order compensator 
structures axe easily accommodated (which is the principal advantage of the 
successive loop closures synthesis method). 

§1.2 Related Literature. In an exhaustive survey of some 50 technical papers, 
Walton (1981) describes advances in the analysis and synthesis of MR systems from 
1953 to 1981. In the early fifties, digital control systems were invariably single- 
input, single-output systems. Multirate sampling got its start at this time as an 
analysis tool. The idea was to attach a “phantom” sampler to the input or output 
port of such a system, and operate it at some integer multiple of the basic sampling 
rate to detect inter-sample ripple. 

Sklansky (1955a, 55b) developed the “frequency decomposition” method for 
determining a transfer function that describes the input-output behavior of a such 
a system. Shortly thereafter, Kranc (1955, 56, 57a, 57b, 57c) developed the “switch 
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decomposition” method, which is an extension of the frequency decomposition 
method that allows sampling rates with ratios that are rational numbers. Chapter 9 
of Ragazzini and Franklin (1958) includes am execllent discussion of the frequency 
decomposition and switch decomposition methods. A multi-input, multi-output 
generalization of the switch decomposition method was recently developed by 
Whitbeck and Didaleusky (1980, 81). 

While, in principle, these methods provide a means to determine a transfer 
function that describes the input-output behavior of MR systems, in practice they 
are extremely cumbersome. Ragazzini and Franklin (1958) discuss an application of 
the switch decomposition method to a single-input, single-output system having two 
samplers with sampling periods T and T/n. The resulting transfer function includes 
n parallel forward paths, each with delay and advance operators. Rao (1979) uses 
switch decomposition to design a compensator for a color videotape recorder, but 
the applications are limited to single loops with two samplers and sampling rates 
related by a small integer. What Rao describes as a “heuristic” overall approach is 
yet another example of the use of the successive loop closures synthesis method. 

The first treatment of MR systems from a state-space perspective appeared in 
an excellent paper by Kalman and Bertram (1959). This paper presents a method 
for formulating a discrete state model to represent a MR sampled data system. For 
the general case of multiple sampling rates, the discrete state model is time- varying. 
For the special case where, for every pair of sampling rates, the ratio of the sampling 
rates is a rational number, the discrete state model is periodically time-varying. 

Amit and Powell (1980, 81) were the first to fully capitalize on Kalman and 
Bertram’s contribution. They developed a computer program to solve the steady- 
state optimal quadratic regulator and the steady-state Kalman estimator synthesis 
problems for a MR sampled data system using eigenvector decomposition. 
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1. Introduction 


Glasson et al. (1979, 80, 81, 82) developed a computer program for determining 
the same steady-state optimal regulator and steady-state Kalman estimator 
solutions by a different method. They obtained the solutions by propagating 
the Riccati difference equations to steady-state, which is a computationally costly 
approach compared to eigenvector decomposition. As an example, they design an 
optimal MR compensator to control the lateral dynamics of the space shuttle during 
reentry (Glasson and Dawd, 1981). 

A disadvantage of optimal MR compensators is that the steady-state regulator 
and Kalman estimator gain matrices are periodically time-varying. However, in a 
study involving a simple mass-spring-mass system and fifty different steady-state 
optimal regulator designs, Amit and Powell (1980, 1981) found only a few cases 
where the performance of an optimal MR regulator was significantly better than 
that of its time-invariant averaged-gains approximation. 

The successive loop closures synthesis method is an indirect approach to MR 
synthesis in that a MR compensator is determined by successively closing a series 
of SR control loops. It is an ad-hoc method in that cross-coupling effects between 
control loops are dealt with as cross-loop disturbances. Except in connection 
with applications, the successive loop closures synthesis method has received little 
attention in the literature. Walton (1981) does not mention it. Albanes (1981), 
Chretien (1982), Penchuck (1983), and Rao (1979) describe some applications of 
the successive loop closures synthesis method to practical design problems. 

The constrained optimization synthesis method, which is the new method that 
was developed in connection with this work, is an outgrowth of the work of Amit and 
Powell (1980, 1981) on optimal MR compensators. The idea is to solve the steady- 
state optimal MR quadratic regulator problem, but with the solution constrained 
to be a linear, constant-gain, state feedback control law. 



1.3 Thesis Outline. 


5 


Broussard and Halyo (1984) developed an algorithm to solve an almost identical 
optimization problem. A problem with their approach is that it cannot handle 
control laws that fail to stabilize the closed-loop system. Thus, the designer must 
determine a stabilizing guess for the control law before the numerical search can 
begin and special logic must be used to (hopefully) avoid destabilizing control laws 
during the search. 

To avoid these difficulties, we chose a different approach. The algorithm that 
we developed relies on a gradient search. The gradients are calculated exactly, 
using a closed-form expression, and a finite-time performance index is used so that 
a stablizing initial guess for the control law is not required. The idea of using a 
finite-time performance index is due to Ly (1982), from his work developing the 
SANDY algorithm for synthesizing robust analog compensators. 

An important additional advantage of our method is that it accommodates 
linear constraints on the elements of the feedback gain matrices. This is an 
important feature because, by adding compensator states to the state vector 
and constraining certain feedback gain elements to fixed values, compensators of 
arbitrary structure and dynamic order can be synthesized. 

§1.3 Thesis Outline. Chapter 2 deals with discretization. It is largely a review 
of material in Amit (1980). Section 2.1 presents a method for generating a discrete 
state model to represent a MR sampled data system. Section 2.2 presents a method 
for generating the discrete equivalent to an analog quadratic performance index for 
a MR sample data system. 

Chapter 3 presents a review of the successive loop closures and optimal control 
law synthesis methods. The successive loop closures synthesis method is discussed 
in Section 3.1. We derive the equations for the steady-state optimal MR quadratic 
regulator and the steady-state MR Kalman estimator in Section 3.2. 
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1. Introduction 


The constrained optimization synthesis method is the subject of Chapter 4. 
Section 4.1 discusses the motivation that led to the development of the method. 
A formal statement of the constrained optimization problem is presented in 
Section 4.2. An algorithm for determining a solution is presented in Section 4.3. The 
solution algorithm requires explicit calculations of the value of a performance index 
and of the gradient of this performance index with respect to the compensator 
parameters. Closed-form expressions for calculating this value and gradient are 
derived in Sections 4.4 and 4.5, respectively. Section 4.6 describes some features 
of the constrained optimization synthesis method that make it a powerful tool for 
synthesizing low-order compensators. 

Chapters 5 and 6 deal with applications. Chapter 5 deals with a mass- 
spring-mass (MKM) system, where good rejection of random disturbances is the 
performance objective. Chapter 6 deals with a two link robot arm (TLA) system, 
where fast servo control of the tip position is the performance objective. These 
studies demonstrate: (1) some potential performance benefits of MR compensation 
over SR compensation, for the same real-time computation load; and (2) some 
relative merits of the three synthesis methods. 

The conclusions of this research and the recommendations for further research 
are presented in Chapter 7. 

§1.4 Contributions. The primary contributions of this research are: 

1. The constrained optimization synthesis method for synthesizing MR or SR 
digital compensators. The advantages of this method are: (l) the control 
laws for all control loops are synthesized simultaneously, taking full advantage 
of all cross-coupling effects; and (2) the compensator structure is arbitrary, 
and simple, low-order compensator structures are easily accommodated. The 
constrained optimization synthesis method relys on a gradient search to 
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determine a control law that minimizes a quadratic performance index. The 
gradients are calculated exactly, using a closed-form expression, and a finite- 
time performance index is used so that a stabilizing initial guess for the control 
laws is not required. 

2. Design studies involving applications of the successive loop closures, optimal 
control, and constrained optimization synthesis methods that demonstate: 
(l) some potential performance benefits of MR compensation over SR 
compensation, for the same real-time computation load; and (2) some relative 
merits of the three synthesis methods. The design studies involve two 
representative design problems, so that the results are applicable to a large 
class of systems. 


Chapter 2 
Discretization 


This chapter deals with discretization. It is largely a review of material in 
Amit (1980). Section 2.1 presents a method for generating a discrete state model 
to represent a MR sampled data system. Section 2.2 looks at the stability of the 
resulting discrete state model. Section 2.3 presents a method for generating the 
discrete equivalent to an analog quadratic performance index for a MR sampled 
data system. The presentations refer to a particular MR sampling policy. As 
presented, however, the methods are quite general and extensions to accommodate 
more complicated sampling policies are noted. 

§2.1 Discretization of an Analog Plant. In their excellent paper, Kalman and 
Bertram (1959) describe a method for generating a discrete state model to represent 
a MR sampled data system. For the general case of a linear, time-invariant, analog 
plant and multiple sampling rates, the discrete state model is time-varying. For 
the special case of a linear, time-invariant, analog plant and multiple sampling 
rates where, for every pair of sampling rates, the ratio of the sampling rates is a 
rational number, the discrete state model is periodically time-varying. We shall 
deal exclusively with sampling policies that result in a discrete state model that 
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Figure 2.1 Example MR Sampling Policy. 


When Kalman and Bertram’s method is applied, the period of repetition of 
the discrete state model is the same as the period of repetition of the sampling 
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2. Discretization 


policy. We shall call this period of repetition the BTP (basic time period). For 
the sampling policy in Figure 2.1, the BTP is 24T. Another characteristic time 
of importance in MR sampling policies is the STP (shortest time period). For the 
sampling policy in Figure 2.1, the STP is T. When Kalman and Bertram’s method 
is applied, the STP of the sampling policy is the time step for the discrete state 
model. (For more complicated sampling policies, it may be advantageous to apply 
Kalman and Bertram’s method in a slightly different way, and split the BTP into 
STPs of unequal lengths. For further information, see Kalman and Bertram (1959).) 

To apply Kalman and Bertram’s method to the sampling policy of Figure 2.1, 
let P represent the number of STPs per BTP. A sampler is “fast” if it is active at 
every STP. A sampler is “slow” if it is not active at every STP. We define P diagonal 
“switching matrices” that describe the sampling schedules for the slow samplers. 
The tth diagonal element of the nth switching matrix is 1 or 0, depending upon 
whether the tth sampler is active or inactive, respectively, at the start of the nth 


STP. For the sampling policy in Figure 2.1, the switching matrices are: 

5(0) = 5(12) = Diag(0, 1,1), (1) 

5(1) =Diag(l,0,0), (2) 

5(2) = 5(5) = 5(7) = 5(10) = 5(11) = 5(13) 

= 5(14) = 5(17) = 5(19) = 5(22) = 5(23) = Diag(0,0,0) , (3) 

5(3) = 5(6) = 5(9) = 5(15) = 5(18) = 5(21) = Diag(0,0,l) , (4) 

5(4) = 5(8) = 5(16) = 5(20) = Diag(0, 1,0) , (5) 


where Diag(di, . . . , d n ) is a diagonal matrix with diagonal elements di, di, . . . , d n . 
We assume that the analog plant is represented by the state equation 


p(i) = F p(i) + G u(t) + G u(t) 4- G w w(t ) , 


( 6 ) 
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for t > 0, where 

u(f) = (ui(t) u 2 (t) «.(*) ] T , (7) 

and p(t) is the state vector, ui(t), u 2 (t), a-^d tts(t) are scalar control inputs, u(t) is 
a vector control input, and w(t) is the process noise input vector. The process noise 
input vector ttf(f) is assumed to be stationary, zero- mean, gaussian white noise of 
intensity W , so that 

E{u;(t) tu T (r)} = W 6(t— r) , (8) 

where E{-} is the expected value operator, and £(*) is the Dirac delta function. 

We assume that the sampling policy is applied such that u t (t) is generated via 
a zero-order hold according to the sampling schedule for sampler #*, for * = 1, 2, 3, 
and u(t) is generated via a vector zero-order hold according to the sampling schedule 
for sampler #4. Let 



(9) 

/ e F ‘dtG, 

(10) 

Jo 

f= f T e Ft dtG . 
Jo 

(11) 


(For a numerical algorithm to solve for $, f , and f given values for F, G , G, and T, 
see Van Loan (1978).) Let la, /«, and I p be identity matrices with the same number 
of rows and columns as there axe elements in u(t), u(t), and p(t), respectively. The 
state equation for the discrete state model is then 

x(m,n + l) = A(n) x(m, n) + B(n ) u(m, n) + B w w(m,n) , (12) 

for m = 0, 1, . . . and n = 0, 1, . . . , P — 1, where 

x(m,n) = [p T (m, n) h\{m,n) /i 2 (m,n) hz(m,n)] T , 
u(m, n) = [ui(m, n) u 2 (m,n) U 3 (m,n) u T (m,n)] T , 


(13) 

(14) 
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w 


(m, n) = f 
JU 


(mP+n+l)T 


(mP+n)T 


e F((mP+n+l)T-0 f 


A[n) = 
B{n) = 


0 (J«-S(n)) 

TS(n) f 
5(n) 0 ’ 


B 


W 


A 
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(15) 

(16) 

(17) 

(18) 


In (13), p(m,n) represents the state p(t) of the analog plant at the (mP+n ) th 
sampling instant. In the same equation, h<(m, n) represents the analog control input 
u,(t), for i = 1, 2, 3, at the (mP-i-n)th sampling instant. In (14), ix,(m,n) is the 
discrete control input that generates h,(m, n), for * = 1, 2, 3. In the same equation, 
u(m, n) represents the analog control input u(t) at the (mP+n) th sampling instant. 
In (15), w(m, n) represents the effect of the analog process noise that occurs between 
the (mP+n— l)th and (mP+n)th sampling instants on the state of the analog plant at 
the (mP+n)th sampling instant. The sequence t v[m,n) is a stationary, zero-mean, 
gaussian, purely random sequence with covariance W D , where 

r T t 

W v = e Ft G w WGl e F Ut. (19) 

Jo 

(For a numerical algorithm to solve for W v given values for F, G w , W , and T, see 
Van Loan (1978).) 

The discrete state model in (12) through (19) is complete, except for the 
measurement equation. Fortunately, a MR measurement scheme is no more difficult 
to handle than a SR one, except that the sampling schedules for all samplers must 
be taken into account when determining the STP and BTP of the sampling policy. 
The discrete measurement equation that corresponds to the discrete state equation 
in (12) is 


y(m, n) = H(n) x (m, n) + v(m, n) , 


( 20 ) 
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where y(m, n) represents the discrete measurement vector at the (mP + n)th 
sampling instant, and v(m,n) represents the discrete measurement noise vector 
at the (mP + n)th sampling instant. If the sampler for the *th sensor is active at 
the (mP+n)th sampling instant, to yield a scalar measurement 

y»(m, n) = Hi x(m , n) + u t (m, n) , (21) 

where v,(m, n) is measurement noise, then the *th row of H(n) is H{. If the sampler 
for the *th sensor is inactive at the (mP + n)th sampling instant, then the tth 
row of H(n) is zero. The discrete measurement noise vector v(m,n) is assumed 
to be a periodically stationary, zero-mean, gaussian, purely random sequence with 
covariance V (n), so that 

E{u(A:,/) v T (m,n)} = V(n) 6(kP+l,mP+n ) , (22) 


where 



if * = j ; 
if • # j . 


(23) 


§2.2 Closed-Loop BTP State Transition Matrix. For the discrete state model 
in (12), suppose that the control input vector u(m,n) satisfies 

u(m, n) = — C(n) x(m, n) . (24) 

Let 

$btf = (A(P-1)-P(P-1)C(P-1)) (A(0) - B(0)C(0)) . (25) 

We shall refer to the time-invaxiant matrix $ B tp as the “closed-loop BTP state 
transition matrix” for the system. The eigenvalues of $btp indicate whether the 
closed-loop system is stable in the BTP-to-BTP sense. Note that a time-invariant 
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analog to $ B tp for the STP-to-STP state transitions does not exist, because the 
discrete state equation is time-varying from one STP to the next. 


§2.3 Discretization of an Analog Performance Index. For the MR sampled 
data system composed of the analog plant in (6) plus the MR sampling policy in 
Figure 2.1, the analog performance index to be considered is 


where 


J{N > ~ E \2NPT J 0 [«(«). 


Q 0 

.0 R\ l«(t)J 


"W 1 dt } , 


«(<) = (« T (0 i T (‘)! T - 


(26) 


(27) 


In (26), E{-} is the expected value operator, T is the STP for the sampling policy, P 
is the number of STPs per BTP for the sampling policy, Q is a symmetric, positive 
semidefinite matrix, and R is a symmetric, positive definite matrix. 

For the analog plant in (6) , let 


p(m , », t) = p((mP +n)T+t ) , (28) 

u(m, n, t) = u((mP+n)T+t ) , (29) 

u(m,n,t) =5((mP + n)r+t). (30) 

Using the properties of the expected value operator, (26) can be written 

^ N ) = WPT ^ • ( 31) 

m = 0 n=0 

where 

T 

j(m,n) = E| 

But p{m,n,t), u (m, n,t), and u(m, n,t) are easily written in terms of the 
discrete state, control input, and process noise input vectors in (12). Letting 


p(m,n,f)' 
u(m, n,t ) 
u(m, n, t) 


Q 0 
0 R 


p(m,n,t) 
ti(m,n,f) 
u(m, n,t) 


dt 


(32) 


m=e Ft ' 


(33) 




2.3 Discretization of an Analog Performance Index. 


15 


T(t) = [ e Fr dr G , 

Jo 

f(f) ^ f e Fr dr G , 

Jo 

(<2.fl) = / e f l‘ !_T) ui(r )dr, 
Ju 


(34) 

(35) 

(36) 


we obtain 


p(m, n,t ) " 


'•(*) 

r(0 (/«-S(n))' 

u(m, n,t) 

= 

0 

(/« - S(n)) 

u(m, n,t) 


0 

0 


T(t) S(n) r(t) 

5(n) 0 

0 


h 


u(m,n) + 




to((mP+n)T+i, ( mP+n)T ) 
0 


. (37) 


for 0 < t < T. 
Let 


«■(») = 


Qd 


= / 


I p 0 0 0 

0 (/ 8 — 5(n)) S(n) 0 

0 0 0 It 

m r(t) f(t) ‘ 

0 /a 0 

0 0 h 


- T 

Q 

o' 



0 

R 



m f(t) T(t) 


0 

0 


In 0 

0 h 


(38) 


dt . (39) 


(For a numerical algorithm to solve for Q D given values for F, G, G, Q, R, and 
T, see Vain Loam (1978).) From (32), substituting for p(m,n,t), ii(m,n,t), and 
u(m,n,t ) using (37), and taking advantage of the fact that 

E{<5((mP+n)T+(,(mP+ n )r) }=0, (40) 

for 0 < t <T, we obtain 

j{m,n) = E{ 

+ J u> T {(mP + n)T+t, {mP-\-n)T) Q w((mP + n)T+t, (mP + n)T) dt j,(4l) 


f 

z(m,n ) 

T 

' Q(n) 

N(n)' 


x(m, n) 

i 

u(m,n) 


N T {n) 

R(n) 


u(m, n) 


where 


Q(») N(n) 
[ N T {n ) R{n ) 


= K T {n) Q d K(n) 


(42) 
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Except for multiplying Q D by iT r ( n ) and K (n), for n = 0, 1, . . . , P — 1, we see 
from (42), (38), and (39) that it is no more difficult to determine the Q(n), N(n), 
and P(n) than it is to determine the corresponding matrices Q, N, and R in the 
SR case. (See Katz (1974) for the corresponding SR development.) Furthermore, 
for the purpose of synthesizing a feedback control law that minimizes J(N), the 
positive semidefinite integral term in (41) can be dropped. This leaves the simpler 
performance index 




m=0 n=0 L 


x(m, n) 
ti(m, n) 


t r 


Q(n) N[n) 
N^in) P(n) 


x(m,n) 
u(m, n) J 


} • («) 




Chapter 3 


Review of Existing Synthesis Methods 


This chapter presents a review of two popular methods for MR synthesis. The 
successive loop closures synthesis method is discussed in Section 3.1. It is virtually 
the only method for MR synthesis in common use. The optimal control law synthesis 
method is discussed in Section 3.2. The equations that define the steady-state 
optimal MR quadratic regulator and the steady-state MR Kalman estimator are 
derived from the corresponding equations for a time-varying SR problem. 


§3.1 Successive Loop Closures. The successive loop closures synthesis method 
is an indirect approach to MR synthesis in that a MR compensator is determined 
by successively closing a series of SR control loops. To design the (n+l)th control 
loop, the approximation is often made that the first n loops respond instantaneously. 
This approximation is often not necessary: If the sampling rates for the different 
control loops are integer multiples of one another, and if the control loops are closed 
in order according to sampling rate, from fastest sampling to slowest, then it is a 
simple matter to obtain an exact representation of the plant with the first n loops 
closed for use in designing the (n-Hl)th loop. 
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Consider an analog plant represented by the state equation 

p(t) = F p(t) + G u(t) + G u(t) , (1) 

where p(t) is the state vector, and u(t) and u(t) are the control input vectors. 
Suppose that the u loop is closed first, at a sampling rate 1/T, using the discrete 
control law 

u(k) = —Cp(k) . (2) 

If the u loop is to operate at a slower sampling rate 1/PT, where P is a positive, 
nonzero integer, then the state model for the u loop design is 

p(Jfc+l) = (A - BC) P p{k) + B u{k) , (3) 

where 

a A f T A rPT 

A = e FT , B= I e Ft dtG, B= f e Ft dtG . (4) 

Jo Jo 

Dynamic compensation is handled just as easily. For the analog plant in (1), 
suppose that the state model that describes the u control loop is: 

c(fc+l) = Ac<:(k) + A p p(k) + Buti(k ) , (5) 

u{k) = -C- c c(k) - C v p(k) , (6) 

where c(k) is the compensator state vector. The state equation for the u loop design 
is then 

p(k+l) 
c(k + 1) 

§3.2 Optimal Control. In this section, the equations that define the steady-state 
optimal MR quadratic regulator and the steady-state MR Kalman estimator are 
derived. The developments are not rigorous. They are a useful supplement to the 
works of Glasson ef al. (1979, 80, 81, 82) and of Amit and Powell (1980, 81). 


A - BC n 


—B Ci 


I Ap Bn Cp Aq Bn 


1 r 

p{k) 

+ 

B 


J(k)_ 

0 


u(k) . 


( 7 ) 
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We start with the finite-time optimal MR control law synthesis problem, because 
the equations for the finite-time optimal MR quadratic regulator and the finite-time 
MR Kalman estimator are easily determined from the corresponding equations for a 
time-varying SR system. The equations for the steady-state optimal MR quadratic 
regulator and the steady-state MR Kalman estimator are then easily determined 
from the corresponding finite-time equations. 


Finite Time Case. An open-loop MR sampled-data plant is assumed to be 
represented by the discrete state model: 

x(m,n-f-l) = A(n) x(m,n) + B(n) u(m,n) + w(m,n ) , (8) 

y(m,n) = H{n)x(m,n) + v{m,n) , (9) 


for m = 0, 1, ... and n = 0, 1, . . . , P — 1, where P is the number of STPs per BTP 
for the sampling policy, x(m, n), u(m,n), w(m,n), y(m, n), and v(m,n ) are the 
discrete state, control input, process noise input, measurement output, and sensor 
noise input vectors, respectively. 

The initial state x(0, 0) is assumed to be a zero-mean, gaussian random vector 
with covariance Xo. The process noise and measurement noise vectors u;(m,n) and 
u(m,n) axe assumed to be zero-mean, gaussian, purely random sequences, with 
covariances W(n) and F(n), respectively, so that 

E{tu(fc,i)u; T (m,n)} = W(n) 6(kP+l,mP+n ) , (10) 

E{v(k,l) v T (m, n)} = V(n ) 6(kP+l,mP+n ) , (ll) 


where E{-} is the expected value operator, and 

R(: ,• j 1 if * = / ; 


( 12 ) 


The process noise, measurement noise, and initial state are assumed to be mutually 
uncorrelated. 
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Given the measurements y(0,0), y(0, l), y(N — 1,P-1), the finite-time 
optimal control law synthesis problem is to determine a control sequence u(0,0), 
u(0, 1), u(N— 1,P — 1) that minimizes the performance index 

J(N) = ±v{x T (N,Q)Q u x(N,0) 

N—lP—l r , .-]T r \ \T r / % 

V-' V-' x(m,n) Q(n) N(n ) x(m,n) 1 

2s 2s u(m,n) N T ( n ) R(n) u(m,n) J’ 

m=0 n=0 j u j l j 

where N is a positive, nonzero integer, Qn is symmetric, positive semidefinite 
matrix, each Q(n) is a symmetric, positive semidefinite matrix, and each R{n) 
is a symmetric, positive definite matrix. 

Except for the double indexing scheme for the independent variables, the finite- 
time optimal MR control law synthesis problem looks just like a finite-time optimal 
SR control law synthesis problem for a time-varying system. The equations for 
the optimal MR regulator and the MR Kalman estimator can consequently be 
determined by inspection of the well-known solution to this related problem. From 
Section 14.7 of Bryson and Ho (1975), by incorporating the double indexing scheme 
for the independent variables and making simple substitutions in notation only, we 
obtain the equations for the finite-time optimal MR regulator and the finite-time 
MR Kalman estimator: 



u(m,n) = — C(m,n)x(m,n) , (14) 

x(m,n) = x(m,n) + if(m,n)[y(m, n) — H[n)x(m,n )\ , (15) 

x(m, n+1) = A(n)x(m,n) + B(rt)u(m,n ) , (16) 

where 

C(m,n) = }B T (n)A(m,n+l)B(n) + iE(n)] -1 

* (5 T (n)A(m,n + l)j4(n) + iV T (rt)] , 

K(m,n) = n(m,n)ff T (n)[iy(n)f2(m, n)H T (m,n) + V'(n)] -1 , 


(17) 

(18) 
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and A(m,n) satisfies 

A(m, n) = A T (n)A(m, n + l).A(n) — C T (m, n)[iE(n) 

+ B T (n)A(m, n+l)B(n)]C(m,n) + Q(n) , (19) 

for A(i\T, 0) = Q n ; and fl(m,n) satisfies 

fl(m,n+l) = A(m, n){fl(m,n) — K{m,n)[H{n)Cl(m,n)H r (m,n) 

+ V'(n)]if T (m,n)}.4 T (m,n) + W(n) , (20) 

for n(o,o)=x 0 . 

In fact, the discretization procedures of Chapter 2 are not quite compatible with 
(14) through (20). To make the dimensions of u(m,n) and y(m, n) the same for all 
n, the discretization procedures of Section 2.1 add, for some values of n , dummy 
control inputs to u(m,n) and dummy measurements to y(m, n). The R(n) in (17) 
and the V(n) in (18) are consequently singular for some values of n. The required 
fix is to delete the columns of zeros from each B(n) and N(n) and the rows and 
columns of zeros from each R{n) that correspond to the dummy elements of u(m, n), 
to delete the rows of zeros from each H (n) and the rows and columns of zeros from 
each V'(ra) that correspond to the dummy elements of y(m, n), and to subsequently 
deal with control input and measurement vectors that have dimensions that vary 
with n. The resulting Q(n) and R{n) are guaranteed to be positive semidefinite and 
positive definite, respectively, if the corresponding matrices Q and R in the analog 
performance index are positive semidefinite and positive definite, respectively. The 
resulting V(n ) are guaranteed to be nonsingular if every physical measurement is 
subject to noise. 

Infinite Time Case. The numerical values for C(m,n) and K(m,n) can be 
determined by propagating the matrix difference equation for A(m, n) in (19) 
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backward and applying (17), and by propagating the matrix difference equation 
for H(m, n) in (20) forward and applying (18). Amit (1980) describes conditions 
involving the controllability and observability of the open-loop plant that guarantee 
that these difference equations settle to unique steady-state values for large N. Not 
surprisingly, these steady-state values are not constant in the usual sense, but are 
functions of n. It follows, from (17) and (18), that the steady-state regulator gain 
matrices and the steady-state Kalman estimator gain matrices are periodic in n as 
well; that is that 


C(m, n) — * C(n) and K(m,n) —*■ K(n) 

for large N. Substituting these steady-state gain matrices into (14) and (16), we 
obtain the equations for the steady-state optimal MR regulator and the steady-state 
MR Kalman estimator: 

u(m, n) = —C(n)x(m,n ) , (21) 

z(m, n) = z(m, n) + fC(n)[y(m, n) — H(n)x(m, n)] , (22) 

x(m,n+l) = A(n)x(m,n) + 2?(n)u(m, n) . (23) 

Amit and Powell (1980, 81) developed a computer program to solve for C(n) 
and K(n) efficiently using eigenvector decomposition. In this approach, a discrete 
state model and performance index are formed that describe the BTP-to-BTP 
responses of the MR system. The BTP-to-BTP state model and the BTP-to- 
BTP performance index are time-invariant and SR. They are used to determine 
the steady-state values for A(m,0) and fl(m,0) directly, using an eigenvector 
decomposition algorithm designed for a time-invariant SR problem. The steady- 
state values for A(m, ra) and fi(m, n), for n = 1, 2, ..., P — 1, are then easily 
determined by propagating the matrix difference equations for A(m, n) and H(m, n) 
backward and forward, respectively, for P — 1 steps. The steady-state values for 
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the gain matrices C(n ) and K(n), for n = 0, 1, . . . , P— 1, are determined from the 
steady-state values for A(m, n) and 0(m, n) using (17) and (18). 



Chapter 4 

The Constrained Optimization Synthesis Method 


This chapter describes a new method for MR synthesis. We shall call it the 
constrained optimization synthesis method. Section 4.1 discusses the motivation 
that led to the development of the method. Section 4.2 presents a formal 
statement of the constrained optimization problem. A numerical search algorithm 
for determining a solution is presented in Section 4.3. The search algorithm requires 
explicit calculations of the value of a performance index and of the gradient of 
this performance index with respect to the compensator parameters. Closed-form 
expressions for calculating this value and gradient axe derived in Sections 4.4 and 
4.5, respectively. Section 4.6 describes some features of the method that make it a 
powerful tool for synthesizing low-order compensators. 

§4.1 Motivation. Amit and Powell (1980, 81) developed an efficient method for 
synthesizing optimal MR compensators. The constrained optimization synthesis 
method is an outgrowth of their work. An advantage of the optimal synthesis 
methods is that the control laws for all control loops are synthesized simultaneously, 
taking full advantage of all cross-coupling effects. A disadvantage of the optimal 
methods is that the resulting compensators are periodically time-varying. However, 
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in a study involving a simple mass-spring-mass system and fifty different steady- 
state optimal MR regulator designs, Amit and Powell (1980, 1981) found only a 
few cases where the performance of an optimal regulator was significantly better 
than that of its time-invariant averaged-gains approximation. This suggests that 
periodicity is often not a prerequisite for good performance in MR compensators. 

The constrained optimization synthesis method was developed to bridge the 
gap between the optimal control law synthesis method and the successive loop 
closures synthesis method. Some advantages of the constrained optimization 
synthesis method are: (1) the control laws for all control loops are synthesized 
simultaneously, taking full advantage of all cross-coupling effects (which is the 
principal advantage of the optimal control law synthesis method); and (2) simple, 
low-order compensator structures are easily accommodated (which is the principal 
advantage of the successive loop closures synthesis method). The basic idea behind 
the constrained optimization synthesis method is to solve the steady-state optimal 
MR regulator problem, but with the solution constrained to be a linear, time- 
invariant, state feedback control law. In addition, linear constraints can be imposed 
on the elements of the feedback gain matrices. This is important because, by 
adding compensator states to the state vector and constraining certain feedback 
gain elements to fixed values, compensators of arbitrary structure and dynamic 
order can be synthesized. 

§4.2 Statement of the Constrained Optimization Problem. An open-loop 
plant is assumed to be represented by the periodically time-varying discrete state 
equation 

x (m, n+l) = A(n) x(m, n) -I- B{n) u(m,n) + w(m,n ) , (1) 

for m = 0, 1, ... and n = 0, 1, ..., P — 1, where x(m,n), u(m, n), and w(m,n) 
are the state, control input, and process noise input vectors, respectively, and P is 
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the number of STPs per BTP for the sampling policy. The initial state x(0, 0) is 
assumed to be zero. Let 



if * = i ; 

if tVj. 


( 2 ) 


The process noise is assumed to be a periodically stationary, zero-mean, gaussian, 
purely random sequence, with covariance W[n), so that 


E{u;(fc,/) tu T (m, n)} = W(n) 6(kP+l,mP+n ) , (3) 

where E{*} is the expected value operator. The process noise and initial state are 
assumed to be uncorrelated. 

The control input u(m, n) is constrained to be a linear, periodically time- 
varying function of the state, so that 


u(m,n) = —C(n)x(m,n). (4) 

The C (n) are further constrained to satisfy 


M-l 

C ( n ) = a ri n )Cr, (5) 

r=0 

where M is a positive, nonzero integer less than or equal to P, each C r is a constant 
matrix, and the a r (n) are scalar functions of n that satisfy 

a p (n)a q {n) = 6(p,q). (6) 


The synthesis problem is to determine a set of feedback gains C r , for r = 
0, 1, . . . , M— 1, such that the performance index 

N-lP-l r , 0 T 

l ). 


, N—i P-1 r . . 

Jss = lim iE rr i m ’" 

N-*oo 2 N u(m,n) 


m=0 n=0 


Q(n) -W(rc) 
iV T (n) R{n) 


z(m,n) 

[u(m,n) 


} (?) 


is minimized, where each Q(n) and R(n) is a symmetric, positive semidefinite 
matrix. 
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Remarks. Two points merit special attention: 

1. In (5), M and the a T (n) are design parameters. For example, if 

M = P and a r (n ) = £(r,n) , (8) 


then 


u(m, n) = -C n x(m,n) , 


( 9 ) 


and the control law is periodically time-varying, in the same manner as the 
unconstrained optimal solution. On the other hand, if M= 1, then 


u(m, n) = — Cox(m,n) , 


( 10 ) 


and the control law is time-invariant. 

2. Although it appears that only full state feedback control laws are considered, 
in practice this is not the case. As shown in Section 4.6, additional linear 
constraints can be imposed on the elements of the C r . This is important 
because, by including compensator states in the state vector and constraining 
certain feedback gain elements to fixed values, compensators of arbitrary 
structure and dynamic order can be synthesized. 


§4.3 Solution Algorithm. The constrained optimization synthesis problem is 
difficult to solve. A closed-form solution for the feedback gains is not known. One 
approach is to invent an algorithm that conducts a numerical search for a set of 
feedback gains that satisfies the necessary conditions 


dJss 

acv 


= o, 


(ii) 


for r = 0, 1, . . . , M— 1, where dJ ss /dC T is the matrix whose (:, j)th element contains 
the gradient of J S s with respect to the (*,j)th element of C r . 
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Broussard and Halyo (1984) developed such an algorithm, for the case of a 
time-invariant (i.e., M = 1) output feedback control law. A problem with their 
approach is that it cannot handle control laws that fail to stabilize the stable closed- 
loop system. Consequently, the designer must determine a stabilizing guess for the 
control law before the numerical search can begin and special logic must be used to 
(hopefully) avoid destabilizing control laws during the search. 

To avoid these difficulties, we chose a different approach. The key to this 
approach is the finite-time performance index 

A 1 




x(m, n) 
— ' I u(m, n) I 

m = 0 »=0 L v J 


Q(n) N(n) 
JV T (») R(n ) 


x(m,n) 
u(m, n) 


} , ( 12 ) 


where the <2(n), R(n ), and N(n) are the same matrices as in (7). The performance 
index J(N) is the finite-time analog of J s s, in that 


Jss = Jim J(N ) . (13) 

N-* oo 

The advantage of working with J{N) instead of J ss is that the gradients 
dJ(N)/dC r , for r = 0, 1, ..., M — 1, exist (and can be calculated) whether or 
not the closed-loop system is stable. The ultimate goal of every optimization is 
to determine a set of feedback gains C r , for r = 0, 1, ..., M — 1, such that (11) is 
satisfied. This is easily accomplished using J{N) by setting N to a value that is 
large enough that NPT, which is the finite time for the performance index J{N), 
is very large compared to the characteristic times of the closed-loop system. 

The computer program that we developed for solving the constrained 
optimization problem is AMS (Algorithm for Multirate Synthesis). AMS reads the 
analog state model, the analog performance index, the sampling rates, the initial 
guess for the feedback gains, and the value of N from an input file. After forming 
the equivalent discrete state model and the equivalent discrete performance index, 
it conducts a numerical search to determine a set of feedback gains that minimizes 
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J(N). The QNMDER algorithm is used for the numerical search. The QNMDER 
algorithm is a gradient-type search algorithm developed by Gill and Murray (1972, 
81). It requires explicit evaluations of J{N) and dJ(N)/dC r , for r = 0, 1 , . . . , M— 1 , 
and uses these to determine an approximate Hessian matrix. 

Once AMS has determined a set of feedback gains that minimizes J(N ), the 
gains are saved on a disk file and execution stops. The designer must then determine 
whether the gains represent a steady-state solution. If not, it is a simple matter 
to run AMS again, for a larger value of N , using the saved feedback gains from 
the previous run as the initial guess. This cycle is repeated for larger and larger 
values of N. A steady-state solution is obtained when NPT gets to be very large 
compared to the characteristic times of the closed-loop system. 

At the early stages of an optimization, when the initial guess for the feedback 
gains is poor, N must be set to a small value to avoid numerical overflow. In each 
subsequent run, as the quality of the initial guess for the feedback gains improves, 
N can be increased by, say, a factor of 10. By re-optimizing for larger and larger 
values of N, a steady-state solution is usually obtained after 4 or 5 runs. See the 
User’s Guide to AMS in Appendix C for further details. 

The key to solving the constrained optimization problem by this method lies 
in an efficient means for evaluating J(N) and dJ{N)/dC T . The expressions for 
J(N ) and dJ[N)ldC r that we developed for AMS are derived in Sections 4.4 and 
4.5. These are closed-form expressions with the special property that the number of 
machine operations per evaluation does not depend on N . For these expressions to 
be valid, the single restriction is that the closed-loop BTP state transition matrix 
must be diagonalizable (see Section 2.2 for a definition of the closed-loop BTP 
state transition matrix). This is not a serious limitation, however, because a non- 
diagonalizable closed-loop BTP state transition matrix rarely occurs. 
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§4.4 Closed-Form Expression for the Performance Index. The derivation in 
this section is modeled after similar developments for time-varying analog systems 
by Kleinman, Fortman, and Athans (1968), Johnson and Athans (1970), and Levine 
and Athans (1970). The key to the derivation is the following theorem, which treats 
the general case of a time-varying system, and includes provisions for a random 
initial state and a quadratic penalty on the terminal state. A proof of Theorem 1 
is given in Appendix B. 


Theorem 1. An open-loop plant is assumed to be represented by the time-varying 
discrete state equation 

x(t+l) = A(t) x{t) + B(t) u(t) + u;(t) , (14) 


for t = to, to + lj • h~ 1, where x(f), u(t), and u>(t) are the state, control input, 
and process noise input vectors, respectively. The initial state x(to) is assumed to 
be a zero-mean, gaussian random vector, with covariance Xq. Let 


Mi * ! 1 = 


(15) 


The process noise w(t) is assumed to be a zero-mean, gaussian, purely random 
sequence, with covariance W(f), so that 


E{iu(t) u> T (r)} = W (*) 6(t, t) , (16) 


where E{-} is the expected value operator. The process noise and initial state are 
assumed to be uncorrelated. 


The performance index is assumed to be 


1 * 1-1 


'z(r)' 

T 

u(r) 



< 3 ( r ) 

N?(r) 


N(t)' 


'x(r) 

. u ( r ). 


}■ 


(i7) 


where Q\ is a sy mm etric, positive semidefinite matrix, and each Q(r) and R(t ) is 
a sy mm etric, positive semidefinite matrix. 
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The control input is assumed to satisfy 


u(£) = — C(£) x(t ) . 


(18) 


Let 

$(r,f) = \a(t-1)-B(t — 1) C(r— 1)1 [A(r-2)-B(r-2)C(r-2)l * ••• 

.[a(()-B(«)C(*)], (19) 

for t = to, £o + l, • • • > t\ ~ 1 and r = t + l, £+2, . . . , t\, and let 

*(t,t) = I x , (20) 


where I x an identity matrix with the same number of rows and columns as there 
are elements in x(£). Let 


QcM = 


I 

T 

’ QM 

*001 

1 

-cm. 


.fT’M 

RM. 

-CM 


Let 


ti-i 


( 21 ) 


= 4> T (fi,r) <?1 $(li,r) + ^2 Qc(ti) $(/i, r) . (22) 

H=T 

T&l 

Then: an equivalent expression for the performance index in (17) is 
1 tl_1 

J = -e{x t (£ 0 ) ^(£ 0 ) x(*o) + u;T ( 7 ') ®(r+l)t»(r)} . (23) 

r=f 0 


Now we apply Theorem 1 to the constrained optimization problem of 


t o = 0, 

(24) 

£1 = ATP, 

(25) 

X 0 = 0, 

(26) 

Q 1 = 0, 

(27) 


Section 4.2, where: 
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A(mP+n) = A(n ) , 


(28) 

B(mP+n) = B(n) , 


(29) 

W(mP+n) = W(n ) , 


(30) 

Q(mP + n) = Q(n) , 


(31) 

JV(mP+n.) = N(n) , 


(32) 

iJ(mP+n) = R(n) , 


(33) 

C(mP+n) = C'(n) , 


(34) 

for m = 0, 1, ... and n = 0, 1, . . . , P — 1, where P is the number of STPs per BTP 

for the sampling policy. 



From (17), using (27), (24), and (25), and substituting for the summation using 

NP - 1 N-lP-l 

J2 /( r ) = LE /( mi> +«) > 

r=0 m= 0 n=0 


(35) 

and using (31) through (33), we obtain 



r _ W V' fi(mP+n)l T [ Q(n) iV(n)l 

2 L u ( mP + n )J *(*)J 

x(mP+n) 1 1 
u(mP+n) J ’ 

(36) 

so that, comparing (12) with (36), 





(37) 

From (19) and (20), using (28), (29), and (34), we obtain 


$(mP+n,mP+l) = $(n,/) , 


(38) 

for / = 0, 1, . . . , P and n = 1,1 + 1, . . . , P, and 



${mP + n,kP+l) = S(n,0) [$(P, 0)] m "* _1 

*(p,0» 

(39) 

for k = 0, 1, . . . , N— 2, m = k+ 1, fc+2, . . . , N— 1, / = 0, 1, — 

, P, and n = 0, 1, . 

..,P. 
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From (23), substituting for ^(r + l) using (22), and using (24) through (27), 
(16), (37), and the properties of the expected value operator, we obtain 

NP-l NP - 1 

J ( N ) = ^ X $ T (M,r + l)Q c (M)$(M,r + 1 ) W i T )- (40) 


r= 0 A*=r+1 

r#JVP-l 


From (40), substituting for the double summation using 
NP-l NP- 1 NP- 1 r— 1 


T=0 /i=r+l 
T*JVP-1 


r=l u=0 
JVP^l 


N - 1 P-1 n 

= E EE« mP+n ’ mP+ '- 1 ) 


m=0 n=l (=1 
P^l 


N - 1 P-1 m— 1 P 

+ X X £E/(«» p +».*j’+/- 1 ), 


we obtain 


m=l n=0 k= 0 /=1 
N#1 


J(JV) = 2JV 1 ^ + * 2) ’ 


where 


AT-l p-i n 


$ T (mP+n,mP+l) 


m=0 n=l 1=1 

P± 1 


m=l n=0 fc=0 i=l 
JV^l 


(41) 


(42) 


* Qc{mP+n) $(mP+n,mP+l)W(mP+l — l ) , (43) 

N - 1 P-i m— l P 

«>=EEEE $ T (mP-(-n,fcP+l) 


* Q c (mP + n)$(mP + n,AP4-/)W(*P+/-l). (44) 


From (43), substituting for $(mP + n,mP-|-I) using (38), and using (21) and 
(30) through (34), we obtain 

N-i P-i » 


( 45 ) 
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Let 


P-i 


Qc( 0 = £$>,/) Q c (n)$(n,/), (46) 

n=l 

for 1 = 0, 1 , . . . , P— 1 . From (45), substituting for the triple summation using 

N - 1 P-1 n P-1 P-1 


E E^™' 1 ) = N 13 S3 /(->.'). 


(47) 


m=0 n=l /=1 
P#1 


i=l n=/ 
Pjtl 


and using (46), we obtain 


P-l 

)h = N £Q C (/)W'(I-1). 

1=1 
P± 1 


(48) 


From (44), substituting for $(mP + n,fcP + l) using (39), and using (21) and 
(30) through (34), we obtain 
N—l P— 1 m— 1 P 

>h = S3 E S3E $T ( i> '')i* T (^o)]’"'‘' 1 * T (".°)%(") 


m=l n=0 *=0 /=1 
Njil 


* $(n,0) [$(P,0)] m '*~ l $(P,/) W{l-l) . (49) 


From (49), using (46), we obtain 

P 


Mi = E $ t PV) Mn$(P,l)W(l-l), 


(50) 


/=1 


where 


N—l m— 1 

= e Ei* T ( p '°)] m '‘' 1 ^(°H*(- p -°)r~‘' 1 - 


(51) 


m=l k=0 
N?1 


Now we assume that the closed-loop BTP state transition matrix $(P, 0) is 
diagonalizable, so that $(P,0) can be written as 


$(P, 0) = S AS-', 


(52) 
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where 5 is an nonsingular matrix and A is a diagonal matrix. Let A,- represent the 
tth diagonal element of A. Let (-) t y represent the operator that returns the (t, j)th 
element of its matrix argument. From (51), using (52), we obtain 

*21 = S~' r J 2l S~ 1 t (53) 


where 


N — 2 m 


W i . = (s'w)s) i .IEr‘» 


m—k 


(54) 


m= 0 k=0 


Nji 1 

Together, (42), (48), (50), (53), (54), (46), (38), (39), and (52) represent 
a formulation for J{N) that is ideally suited to the optimization algorithm of 
Section 4.3, In particular, the summation in (54), which is the only summation 
with limits that depend on N , can be evaluated in closed-form using formulas 
in Gradhteyn and Ryzhik (1980), so that the number of machine operations per 
performance index evaluation is independent of N. 


§4.5 Closed-Form Expression for the Gradient. The derivation in this section 
is modeled after similar developments for time- varying analog systems by Kleinman, 
Fortman, and Athans (1968), Johnson and Athans (1970), and Levine and Athans 
(1970). The key to the derivation is the following theorem, which treats the general 
case of a time-varying system, and includes provisions for a random initial state 
and a quadratic penalty on the terminal state. A proof of Theorem 2 is given in 
Appendix B. 

Theorem 2. An open-loop plant is assumed to be represented by the time- varying 
discrete state equation 


z(t + l) = A{t) x(t) + B(t) u{t) + w{t ) , 


(55) 
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for t = to, to + 1, t i — l, where x(t), u(t), and w(t) axe the state, control input, 

and process noise input vectors, respectively. The initial state x(t o) is assumed to 
be a zero-mean, gaussian random vector, with covariance Xq. Let 



if i = j ; 
if t # j . 


(56) 


The process noise w(t) is assumed to be a zero-mean, gaussian, purely random 
sequence, with covariance W{t), so that 


E{u;(t)u; T (r)} = W(t)6{t,r), (57) 


where E{-} is the expected value operator. The process noise and initial state are 
assumed to be uncorrelated. 

The performance index is assumed to be 


j£iE{x T (ti)<?n(ti) + £ 


r=f 0 


'x(r)' 

T 

u(r) 



CM r) 

IT(r) R(t) 


x(t) 


} . (58) 


where Q\ is a symmetric, positive semidefinite matrix, and each Q(t) and R(r) is 
a symmetric, positive semidefinite matrix. 

The control input is assumed to satisfy 


u(t ) = — C(t) x(t) . 


(59) 


The C(t) axe further assumed to satisfy 

M - 1 

C(t) = £ *r{t)Cr, (60) 

r=0 

where M is a positive, nonzero integer less than or equal to t\ — to, each C T is a 
constant matrix, and the a r (t) are scalax functions of t that satisfy 


a p (!) a,(() =6(f,q). 


(61) 
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Let 

$(r,t) = Ja(t — 1) — B(t — 1) C(t— l)j ^4(r — 2) — B(r — 2) C(r — 2)j *••• 

* [a(0-b(0c(0], (62). 

for t = to, to + li . . ., h — 1 and r = f+l, t+2, . .. , t\, and let 

*(t,t)=I x , (63) 

where I x an identity matrix with the same number of rows and columns as there 
are elements in x(t). Let 

Let 

a <1_1 

¥(r) = $ T (t 1 ,r)Qi$(*i,r)+ ^ QcM $(m, t) . (65) 

H-T 

r & l 

Let 

\&(r) = —N t (t) + R(t) C(r) — B T (r) Vt^r+l) |j4.(t) — B(t) C(r)| . (66) 

Then: if dJ/dC r represents the matrix whose (*, jf)th element contains the gradient 
of J with respect to the (t,j)th element of C f , 

%~ r = [X^«r(r)^(r)$(r,t 0 )Xo$ T (r,t 0 )] 

r r=to 

+ [J2 a r (r)¥(r)$(r, 

r=4 0 +l M=fo 
to^h-1 

for r = 0, 1, . . . , M — 1. 

Now we apply Theorem 2 to the constrained optimization problem of 
Section 4.3, where: 


H+l)W(ii) $ T (r,/z+l) , (67) 


Q(n) jV(/z)l [ / 

JV t ( M ) R{n) -cm • 


(o = o, 


( 68 ) 
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h=NP , 

(69) 

X 0 = 0, 

(70) 

<3i =0, 

(71) 

4(mP+n) = A(n) , 

(72) 

B(mP+n) = B(n ) , 

(73) 

PF(mP+n) =W(n), 

(74) 

Q(mP+n) = Q(n) , 

(75) 

iV(mP+n) = W(n), 

(76) 

P(mP+n) = R(n ) , 

(77) 

a r (mP+n) = a r (n) , 

(78) 

C(mP-f-n) = C(n) , 

(79) 


for m = 0, 1, . . . and n = 0, 1, . . , , P — 1, where P is the number of STPs per BTP 
for the sampling policy. 

From (61), using (71), (68), and (69), and substituting for the summation using 
NP-i N-i P - 1 

A r ) = f( mP + n ) > ( 80 ) 

r= 0 m= 0 n=0 


and using (75) through (77), we obtain 

N-l P-1 r / ~ ^ t T r 


_ I E f V' V [ z(mP + n) 
J ~ 2 ^ u(mP+n) 

m=0 n=0 L v ' 

so that, comparing (12) with (81), 


Q(n) iV(n) 
JV T (n) P(n) 


x(mP+n) 

u(mP+n) 


} . ( 81 ) 


J(N) = 



(82) 


From (62) and (63), using (72), (73), and (79), we obtain 


$(mP + n,mP+J) = $(n,/), 
for / = 0, 1, . . . , P and n = l, 1 + 1, . . . , P, and 


( 83 ) 




4.5 Closed-Form Expression for the Gradient. 


39 


$(mP+n,kP+l) = $(n,0)[$(J > ,0)]"‘‘" 1 $(P,l), 


(84) 


for k = 0, 1, . . . , N— 2, m = k+ 1, k+ 2, . . . , N— 1, / = 0, 1, . . . , P, and n= 0, 1, . . . , P. 
Let 

C(t, fi) = a r {r) J-JV T (r) + i2(r)C(r)] $(r,/z+l) W(fj.) $ t (t,m + 1) , (85) 


and let 


D{t,h) = a r (r) |-B T (r) tf(r-f-l) [A(r)-B(r) C(r)] | 

* $(r,/i-|-l) W(n) $ T (r,/i+l) . 


(86) 


From (67), substituting for $(r) using (66), and using (70), (68), (69), (82), (85), 
and (86), we obtain 

dJ{N) 1 - NP ~ l f_1 


-JcT = n[I1 EC(r lM ) + P(r,d . 


(87) 


r=l /j=0 
NPjil 


To simplify the notation, we assume that P > 2. From (87), substituting for 
the double sum over C (r, n) using 

NP-lr-l AT-lP-ln— 1 

]£ = Y1 S Ylf( mP+n ' mP + l ) 

r= 1 j*=0 m= 0 n=l 1=0 

N- 1 P-1 m— 1 P-1 

+ E 2Z Zl S /(mP + n,A;P+0 , 

m= 1 n=0 jfc=0 1=0 
JV^l 


(88) 


and for the double sum over D(t, h) using 
NP-l r— 1 P-2 

r=l jx=0 1=0 

P-2 n— 1 IV- 1 P-2 

+ E Ei'<(w-i)p+n,(jv-i)p+i) + e Effl--i)f+f-M'"-i)f+i) 

n=l 1=0 m=l 1=0 

P^2 JV^l 

N-2 P-2 n— 1 N—2 P-1 

+ E EE/( mP+n > mP +')+E E/(( JV - 1 ) p + p - 1 ' tp+ ') 

m=0 n=l 1=0 i=0 1=0 
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+ '£'£ T,m N -i)p+*,i=p+‘)+ Y ££/«"■- i)p+p-i,kp+t) 


n-0 k = 0 1=0 
JV#1 


m =2 fc =0 1=0 

N? 1 

N?2 


N—2 P-2 m— 1 P-1 

+ EIEE f(mP+n,kP +/) , (89) 

m=l n=0 Jk=0 1=0 

N^l 

Nyi 2 


we obtain 


3J{N) 

dC r 



+ C 2 4- Pi + P 2 4- Dz + Pa + Ps + P& + P 7 + 


(90) 


where 


AT-1 P-1 n— 1 

Ci = ^2 51 C(mP+n,mP+/) , 

m=0 n=l 1=0 
N- 1 P—1 m— 1 P—1 

C 2 = Y, E H C(mP+n,*P+0 , 

m=l n=0 *=0 1=0 
N? 1 

P-2 

(91) 

(92) 

A = 51 P((^-1)P+P-1, (JV-1JP+/) , 
1=0 

P-2 n— 1 

(93) 

t > 2 = 5Z Ew- 1 ) p+n ’( iV - 1 ) p+/ )> 

n=l J=0 
P# 2 

AT-1 P-2 

(94) 

ft= £ E p (( m - 1 ) p+p - 1 '( m - 1 ) p+ '). 

171 — 1 1=0 

AT#1 

AT- 2 P-2 n— 1 

(95) 

Ai = 5Z 51 S ^( mP + rl ’ mP + / ) ’ 

m=0 n=l /=0 
A/^l P#2 

AT— 2 P-1 

(96) 

*=Y E p (^- 1 ) p+p - 1 - ip+ '). 

Jfe=0 J=0 
A/^l 

P-2 AT- 2 P-1 

(97) 


f«=EE ^P((^-l)i > +n,AP+l). 


(98) 
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N- 1 m— 2 P-1 

th = E (99) 

m=2 Jk=0 /=0 

AT^l 

N*2 


N—2 P—2 m— 1 P-1 

As = XI E XI P(mP + n,fcP+/). (100) 

m=l n=0 i=0 i=0 

N?l 

N?2 


From (91), substituting for C(mP + n, mP + l) using (85) and for 
$(mP+n,mP+/ + l) using (83), and using (74) through (79), we obtain 


Cl = EE Em*) (-N T (n)+K(n)C(n)) 

m=0 n=l (=0 

* $(n,/ + l) W(l) $ T (n,/+l). 


( 101 ) 


Let 

n— 1 

W{n) = *(»,* + 1) W{1) $ T (n,/ + l) , (102) 

1=0 

for n= 1, 2, . . . , P. From (101), using (102), we obtain 

P - 1 

Cl = N £ «r(n) (-iV T (n) + P(n)C(n))i^(n) . (103) 

n=l 

And (103) and (102) represent an ideal formulation for C i in that all summation 
limits are independent of N. 

The corresponding development for Ci is only slightly more complicated. From 
(92), substituting for C(mP+n,AP+i) using (85), and for $(mP+n,iP+l+l) using 
(84), and using (74) through (79), we obtain 
N—l P-lm-lP-l 

*-EEEE oc r (n) (~N T {n)+R(n)C{n)') 

m = 1 n= 0 jfc=0 1=0 
N? 1 

* S(n,0) [$(P,0)] m “*- 1 S(P,f + l)W(Z) 

* $ T (P,/ + 1) [$ T (P,0)] m ~* _1 $ T (n,0) . (104) 
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From (104), using (102), we obtain 
P - 1 

Ci = YL af ( n ) (-N T (n) + P(n)C(n)) $(rt>0) C 21 $ T (n,0) , (105) 

n=0 

where 

N — 1 m— 1 

C„ = ^ £[*(p,o)]— *-»iF(p) *“* • (ioe) 

m=l Jfe=0 
Nj±l 

Now we assume that the closed-loop BTP state transition matrix $(P, 0) is 
diagonalizable, so that $(P, 0) can be written as 


*(P,0) = SAS- 1 , (107) 

where S is a nonsingular matrix and A is a diagonal matrix. Let A,- represent the 
ith diagonal element of A. Let (*)yy represent the operator that returns the (*’, j)th 
element of its matrix argument. From (106), using (107), we obtain 

C 21 = S C 21 S T , '(108) 


where 

N — 2 m 

(c 2 i).. = ( 5 _ 1 iy(p) 5 ~ t ) .. J 3 Y , x ?~ kx ?~ k • (109) 

t} 13 m= 0 k = 0 

Nji 1 

And (105), (108), (109), and (102) represent an ideal formulation for C 2 in that: 
(l) the summation limits in (105) and (102) axe independent of JV; and (2) the 
nested sum in (109) is a finite series that can be evaluated in closed-form using 
formulas in Gradhteyn and Ryzhik (1980). 

The corresponding developments for V\ through D$ follow the same design. 

From (65), using (71) and (69), and substituting for the summation using 
NP-i P- 1 

53 /(M,mP+n) = [53 /( m P+g,mP+n)] 

fi=mP+n q=n 

N - 1 P-1 

+ [ 53 53j r (P P + <7,mP+»)J » 

p=m + 1 ?=0 
m^N—1 


(no) 
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for m = 0, 1, . . . , N — 1 and n = 0, 1, . . . , P — 1, and using (64), (75) through (77), 
and (79) we obtain 

P - 1 

$(mP+n) = [£ $(mP+q,mP+n) Q c [q) $ T (mP-hg,mP + n)j 

?=n 

N - 1 P-1 

+ [ XI X $ (P- P + 9’ mP + n ) Qc(q) [pP +q,mP + n)] j(lll) 

p=m+l q = 0 
m?N - 1 

for m=0, 1, . . . , N — 1 and n=0, 1, . . . , P — 1, and 

tf(JVP)=0. (112) 

From (93), substituting for D((N — 1)P+P — 1, (N— l)P+l) using (86), and for 
'if(NP) using (112), we obtain 

Di=0. (113) 

Let 

P - 1 

Qc(n) = $T (?> n ) ^(9) > ( 114 ) 

q=n 

for n = 0, 1, . . . , P—1. From (94), substituting for D((N—l)P+n, (N—l)P+l) using 
(86), for ^((iV — l)P + n+l) using (111), and for $((JV — l)P + n, (N — 1)P + J + 1) 
using (83), and using (72) through (74), (78), (79), (102), and (114), we obtain 

P-2 _ ^ 

Vi — - X a r(n) B T (n) Qc( n +1) $(n-J-l,n) W{n ) . (115) 

n=l 

P^2 

From (95), substituting for P((m— 1)P+P— 1, (m— 1)P+/) using (86), for $(mP) 
using (ill), and for $((m — 1)P + P — l,(m — l)P+/ + l) using (83), and using (72) 
through (74), (78), (79), (102), and (114), we obtain 

Vz = -a r (P-l)B T (P-l)P 3 i$(P,P-lf(P-l), (116) 

where 

N - 1 N - 1 

m=l p=m 
Njil 


( 117 ) 
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From (117), substituting for $(P, 0) using (107), we obtain 

Vz\ — S~ T Vz\ S' 1 , (118) 


where 

(psi).. = (s t q o (0)s).. e e (ns) 

m = 0 p=m 

From (96), substituting for P(mP+n,m?+/) using (86), for $(mP+n+l) using 

(ill), and for $(m?+n,mP+i+l) using (83), and using (72) through (74), (78), 

(79), (102), and (114), we obtain 
P-2 

= - X) a '( n ) BT ( n ){( JV ~l)Q c ( n + 1 ) + $ T (P,n+ 1) P 41 $(P,n+ 1) J 


* $(n+l,n) W(n ) , (120) 


where 

N-2 N-i 

p«=E Z wp.oir-'femwp.if 1 . (121) 

m=0 p=m+l 

From (121), substituting for $(P,0) using (107), we obtain 

P 4 i = 5- t P 4 i5- 1 , (122 ) 


where 

.. = (s T Q o (0)s).. E E AP"Af”. (123) 

** m= 0 P=m 

AT/1 

From (97), substituting for D((N—1)P+P—1, kP+l) using (86), and for 'b(NP) 
using (112), we obtain 

Ds = 0 . (124) 

From (98), substituting for D((N—l)P+n, kP-H) using (86), for ^((iV— l)P+n+l) 

using (ill), and for $((iV — l)P + n, A:P + / + l) using (84), and using (72) through 

(74), (78), (79), (102), and (114), we obtain 
P-2 

Dq = -^2 a r( n ) -B T («) Q c (n+1) $(^+1,0) Dqi $ T (n,0) , 



(125) 
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where 


N - 1 


Dei = ]T [^(PjO)]^ -1- * W{P) [$ T (P, 0)]* -1 "*, 

k=l 

N^l 

From (126), substituting for $(P,0) using (107), we obtain 


(126) 


Dei = S DeiS T , 


(127) 


where 

N- 2 

(p 6 i) = (5- 1 iy(P)5" T ). J2 Af- 2 "* \f ~ 2 ~ k . (128) 

13 k = 0 
N^l 

From (99), substituting for D((m — 1)P + P — 1, kP + l) using (86), for $(mP) 
using (111), and for $((m— 1)P+P— 1, fcP+/+l) using (84), and using (72) through 
(74), (78), (79), (102), and (114), we obtain 

D 7 = -o f (P - 1) B T (P-1) Dn $ T (P - 1, 0) , (129) 

where 

N-l m-lN-l 

D* T (p,o)r"« 0 (o)[*(p,o)r‘ 

m=2 *=1 p=m 

N^ti 

N? 2 

* W(P) [$ T (P, 0)] m “ 1- * . (130) 


From (130), substituting for $(P, 0) using (107), and letting z denote the number 
of elements in x(m,n), we obtain 

D 7 \ = S~ T D 7 \ 5 t , (131) 


where 




N- 3 m /V— 3 

* E EErr‘r‘ 


( 132 ) 
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From (100), substituting for D{mP + n,kP + 1) using (86), for $(m? + n+l) 
using (111), and for $(mP+n,kP+l+ 1) using (84), and using (72) through (74), 


(78), (79), (102), and (114), we obtain 



P-2 

D s = -^2 a r( n ) B T (n) j<? c (n+l) $(n+l,0) P 8 i 

n=0 

* $ T (P,n+l) P 82 }$ T (n,0) , 

(133) 

where 

N—2 m 

Du = £ 5>(Ao)p-*w(p)[§ T (p,o)n-\ 

(134) 


m= 1 Jt=l 
N*l 
N? 2 

N—2 m N- 1 

a.= EE E [« T (i > ,o)r m - i o c (o)[#(p,o)r‘ 

m= 1 Jk=l p=m+ 1 

JV^l 

N?2 

*iv(p)($ T (p, o)] m_ *. 

(135) 

From (134), substituting for $(P, 0) using (86), we obtain 



P 8 1 = S V % 2 5 T , 

(136) 

where 

(Psi) . . = (5- 1 W(P) 5" t ) .. £ £ x ?~ k x T~ k ■ 

(137) 

' m=0 k=0 

Nji 1 
N?2 

From (135), substituting for $(P,0) using (86), we obtain 



Dq2 = 5' _T P 8 2 5 T , 

(138) 


where 


(P 82 ) =E( ST <?c(°)s) i( ,(s-‘^WS- T ) w 

0=1 

N - 3 m N—3 

* EEErCY 4 ' 


(139) 
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Together, (90), (103), (105), (108), (109), (113), (115), (116), (118), (119), 
(120), (122), (123), (124), (125), (127), (128), (129), (131), (132), (133), (136), 
(138), (137), (139), (102), (114), (83), (84), and (107) represent a formulation for 
dJ(N)/dC r that is ideally suited to the optimization algorithm of Section 4.3. 
In particular, all summations with limits that depend on N can be evaluated in 
closed-form using formulas in Gradhteyn and Ryzhik (1980), so that the number of 
machine operations per gradient evaluation is independent of N. 


§4.6 Linear Constraints on the Feedback Gains. An advantage of the solution 
algorithm of Section 4.3 is that additional linear constraints can be imposed on 
the elements of the feedback gain matrices. Let x and u represent the number 
of elements in x(m, n) and u(m, n), respectively. If the elements of the C r are 
constrained to satisfy 

M - 1 « x 

(cv) =[211121 k ”ir* V q (c'm) ] + Irij » ( 140 ) 

m=0 p=l <7=1 » y 

for r = 0, 1, . . . , M— 1, * = 1, 2, . . . , u, and j = 1,2, . . . , x, where each k r ij mpq and 
l ri j is a constant, then, from elementary calculus, 

dJ(N) \ * yY'l dJ(N) 

s(Cr)J £z%£; m ""’ s(c m ) P , ’ 



where dJ(N)/d(C m ) pq on the right-hand side is the gradient ignoring the 
constraints, and ( dJ{N)/d[C r )ij )* on the left-hand side is the gradient with the 
constraints in effect. In particular, if ( C r )ij is to be constrained to be fixed, so that 


(C r ).. = l riy , (142) 

then, from (140) and (141), 

V«(ev)« 



( 143 ) 
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and we see that constraining a feedback gain element to be fixed is as simple as 
zeroing the corresponding gradient element. 

As indicated in Appendix C, AMS offers the designer the option to constrain 
any feedback gain element to be fixed. This is important because, by adding 
compensator states to the state vector and constraining certain feedback gain 
elements to be fixed, compensators of arbitrary structure and dynamic order can 
be synthesized. 




Chapter 5 

Mass- Spring-Mass Design Example 


In this chapter we deal with an example design problem involving a simple 
mass-spring-mass (MKM) system. The open-loop system is described in Section 5.1. 
The compensator design work is described in Section 5.2. A method for determining 
the steady-state state and control covariance responses to a prescribed process noise 
is developed in Section 5.3. Performance comparisons for the different compensators 
are presented in Section 5.4. Section 5.5 presents a summary and discussion of the 
important results. 

§5.1 Open-Loop System Description. The open-loop MKM system is shown 
in Figure 5.1. Rigid bodies A and B have masses M and m, respectively, and are 
connected by a linear spring with spring constant k. Generalized coordinate x\ is 
the displacement of A with respect to a fixed point. Generalized coordinate x-i is 
the displacement of B with respect to A. The control inputs u and u are forces 
acting on A and B, respectively. The process noise w c is modeled as a force acting 
on B that satisfies the state equation 

w c {t) = — aw c (t) + V2aw(t) , 


( 1 ) 
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Figure 5.1 Open-Loop MKM System. 


with u/ c (0) = 0, where w(t) is stationary, zero-mean, gaussian white noise of unit 
intensity, so that 

E{w(t)} = 0, (2) 

E{u;(t + r)u;(t)} = 6(r ) , (3) 

where <5(-) is the Dirac delta function. From (1) through (3), we obtain 


E{ti> c (*)} = °, (4) 

lim E{u; c (f + 7-)u; c (t)} = e -0 l T l , (5) 

f-*oo 

so that, in the steady-state, u; c (t) is a stationary, zero-mean, gaussian random 
process of unit variance, with correlation time 1 /a. 

The dynamics of the plant plus the process noise are represented by the analog 
state equation 

x(t ) = F x (f) + G u{t) -f- G u(t) + Gxu , (6) 


where 


x(f) = [a;i(t) i\ (t) *2(0 *2(0 MO] 1 


F = 


G= [0 


1 

0 

0 

0 

0 


b 0 


o 

k_ 

M 

-(b+b) 

0 

-b o; 


0 

0 

1 
o 
o 


o 

o 

o 


m 
— aj 


(0 

( 8 ) 

( 9 ) 
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G = [0 0 0 i 0] T , (10) 

<?„ = [0 0 0 0 V5a) T . (11) 

§5.2 Compensator Designs. The section describes the compensator design work. 
The coverage is in 5 subsections, although, in practice, the design process is not 
so conveniently separable. The subsections describe the performance objectives, 
the compensator structure, the sampling policies, and the synthesis of the different 
compensators. 

Performance Objectives. The performance objective was to minimize the 
system’s responses to the process noise w c {t). This was to be accomplished using 
reasonable levels of control, and the real-time computation load was to be as low 
as possible. 

Compensator Structure. The compensator was constrained to be a constant 
gain control law, with u feeding back X\ and xi, and u feeding back xi and X2. 

Sampling Rates Selection. For sampling rates selection, we first expressed the 
performance objectives in terms of the desired locations for the closed-loop poles in 
the s-plane. We dealt with cases where M»m and the spring is soft — soft enough 
that the open-loop vibration frequency is substantially less than the characteristic 
frequency of the high frequency closed-loop poles. Under these conditions, the 
xi/ii-to-u and X 2 /z 2 -to-u control loops axe primarily coupled to the low frequency 
and high frequency closed- loop poles, respectively. 

The following subsection describes the specific design cases that we considered. 
One MR compensator and one SR compensator were designed for each design 
case. Let S 5R represent the sampling rate for a SR compensator. Let S M ri 
and 5 M r 2 represent the sampling rates for the xi/xi-to -u and X 2 /X 2 -to-u control 
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loops, respectively, for a MR compensator. For real-time operation of either 
compensator, the number of multiplications per u update is the same as the number 
of multiplications per u update. Consequently, the computation loads for real-time 
operation of the two compensators will be the same if S MR1 , S M R 2 > and S SR satisfy 

<Fmri + *Fmr2 = 2 Ssk • (12) 

For each design case, we picked ‘S'sR such that 

S S R = ^SR /cL2 » (13) 

where / CL2 represents the characteristic frequency in hertz of the high-frequency 
desired s-plane closed-loop poles, and /e SR was either 5 (for a slow-sampling-rates 
case) or 20 (for a fast-sampling-rates case). For the same design case, we picked 
‘S’mri and Smr2 using 

Smri = ^mr /cu and Smr 2 =: &mr /cl 2 » (14) 

where k MR is a constant, and / c lx and / c L 2 represent the characteristic frequencies 
in hertz of the low-frequency and high-frequency desired s-plane closed- loop poles, 
respectively. To ensure that the computation loads for real-time operation of the 
two compensators are the same, we picked fc MR (and thus •S'mrx and S MR2 ) such that 
(12) is satisfied. 

Specific Design Cases. Tables 5.1 and 5.2 describe in detail the specific design 
cases that we considered. There axe three cases in all. One MR and one SR 
compensator were designed for each design case. Table 5.1 lists the values of all 
fixed parameters. The case-dependent parameters are in Table 5.2. The mass 
ratio M/m is fixed at 10. The break frequency a for the process noise shaping 
filter is fixed at a laxge value compared to the characteristic frequencies of the 
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desired s-plane closed-loop poles, so that the process noise is effectively white. The 
symbols / and f denote a natural frequency and a damping ratio, respectively, with 


the subscripts OL or CL indicating open-loop or closed-loop, respectively, and the 
trailing 1 or 2 indicating association with the low frequency or high frequency poles, 
respectively. The parameter S s r represents the sampling rate for a SR compensator. 
The parameters S M R1 and represent the sampling rates for the xi/xi-to-u and 
X 2 /x 2 -to-u control loops, respectively, for a MR compensator. 


Table 5.1 Fixed MKM Parameters. 


PARAMETER 

VALUE 

M 

1 kg 

m 

0.1 kg 

a 

IOOOtt sec -1 

foil 

0 hertz 

•Ton 

0 

C0L2 

0 

fen 

1 hertz 

fcLl 

l/y/2 

fCL2 

1/V2 


Table 5.2 Variable MKM Parameters. 




NUMERIC VALUE 

PARAMETER 

UNITS 

Case 1 

Case 2 

Case 3 

/oL 2 

hertz 

4 

2 

4 

/CL 2 //CLI 

— 

8 

4 

8 

SuK2 / ‘S'mRI 

— 

8 

4 

8 

Ssr/ /cL2 

samples/cycle 

5 

5 

20 

S’mR2/‘S'sR 

— 

1.78 

1.6 

1.78 


For Design Case 1, the desired s-plane closed-loop poles are critically damped 
and have characterise frequencies of 1 and 8 hertz. Taking 8 hertz as the desired 
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closed-loop bandwidth for the x^/xi-to-ii control loop, we picked S SR using (13) 
at 40 samples /second, or 5 times this desired control bandwidth. For the MR 
compensator, taking 1 and 8 hertz as the desired control bandwidths for the xi/ii- 
to-u and xi/xi-to-u control loops, respectively, we picked S MR1 and S MR2 using (12) 
and (14) at 8.89 and 71.1 samples /second, respectively, or 8.89 times the associated 
desired control bandwidths. 

Design Case 2 is the same as Case 1, except that the characteristic frequency 
of the high frequency desired s-plane closed-loop poles is 4 hertz. Taking 4 hertz 
as the desired closed-loop bandwidth for the xi/ii-to-u control loop, we picked 
£ S r using (13) at 20 samples/second, or 5 times this desired control bandwidth. 
For the MR compensator, taking 1 and 4 hertz as the desired control bandwidths 
for the xi/ii-to-u and xi/ii-to -u control loops, respectively, we picked S MR1 and 
S MR2 using (12) and (14) at 8 and 32 samples/second, respectively, or 8 times the 
associated desired control bandwidths. 

Design Case 3 is the same as Case 1, except that all sampling rates are 
increased by a factor of 4. For the SR compensator, we picked S SR using (13) 
at 160 samples/second, or 20 times the desired control bandwidth for the X 2 /X 2 - 
to-u control loop. For the MR compensator, we picked 5 MR i and S MR2 using (12) 
and (14) at 35.6 and 284 samples/second, respectively, or 35.6 times the associated 
desired control bandwidths. 

Synthesis. All compensators were synthesized using the successive loop closures 
synthesis method of Section 3.1. For each MR compensator, we synthesized the 
control law for the xi/xi-to-u control loop first, then re-discretized the model at 
the slower sampling rate with the X 2 /x 2 -to-u loop closed and synthesized the xi/xi- 
to-u control loop. The same procedure was used for each SR compensator except 
that the same sampling rate was used for both control loops. With only one position 
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feedback gain and one rate feedback gain in each control loop, the feedback gains 
were easily determined by trial and error using interactive computer displays of the 
closed- loop poles. 

Figure 5.2 is a z-plane plot of the control loop design for the Case 1 

MR compensator. The sampling rate is 71.1 samples/second. The os are the open- 
loop poles. The Os are the high frequency desired closed-loop poles. The xs are the 
actual closed-loop poles. The X 2 -to-u and X 2 -to-u feedback gains are 91.8 N/m/sec 
and 5.24 N/m/sec, respectively. 

Figure 5.3 is a z-plane plot of the subsequent xi/xi-to -u control loop design 
for the Case 1 MR compensator. The sampling rate is 8.89 samples/second. The 
os are the low frequency (i.e., rigid body) open-loop poles. The Ds near the origin 
are the high frequency desired closed-loop poles. The other □ pair are the low- 
frequency desired closed-loop poles. The xs are the actual closed-loop poles (the 
final closed-loop poles with the Case 1 MR compensator), obtained for xi-to-u and 
xi-to-u feedback gains of 25.4 N/m and 7.30 N/m/sec, respectively. In Figure 5.3, 
the small movements of the high frequency closed-loop poles away from their desired 
locations axe due to the closure of the xi/ii-to-u control loop. These movements 
are one consequence of the approximations inherent the application of the successive 
loop closures synthesis method. 

Figure 5.4 is a z-plane plot of the Case 1 SR compensator design. The sampling 
rate is 40 samples/second. The os are the open-loop poles, the Ds are the desired 
closed-loop poles, and the xs are the final actual closed-loop poles. The small 
movements of the high frequency closed-loop poles away from their desired locations 
are again due to the closure of the xi/xi-to-u control loop. 

For completeness, the z-plane plots of the desired and final actual closed-loop 
..poles for the Case 2 and 3 compensators are included in Figures 5.5 through 5.8. 
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O Open-Loop 
□ Desired 
X Actual/^ 





i i I I l 1 l l I I 

-1 -0.75 -0.50 -0.25 0 0.25 0.50 0.75 1 


Real Part{*} 

Figure 5.2 Case 1 MR Compensator xi/xz-to-u Loop Design. 



Imaginary Part{z} 

-0.75 -0.50 -0.25 0 0.25 0.50 0.75 


5.2 Compensator Designs. 


57 



Figure 5.3 Case 1 MR Compensator xi/ii-to-tZ Loop Design. 



-0.75 -0.50 -0.25 0 0.25 0.50 0.75 


58 


5. Mass-Spring-Mass Design Example 



Figure 5.4 Case 1 SR Compensator Design. 



Imaginary Part{«} 
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Figure 5.5 Closed-Loop Poles with Case 2 MR Compensator. 
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Figure 5.6 Closed-Loop Poles with Case 2 SR Compensator. 
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Figure 5.7 Closed-Loop Poles with Case 3 MR Compensator. 
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i 1 i 1 1 1 — i 1 1 

-1 -0.75 -0.50 -0.25 0 0.25 0.50 0.75 1 
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Figure 5.8 Closed-Loop Poles with Case 3 SR Compensator. 
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The feedback gains for the MR and SR compensators for all three design cases are 
in Table 5.3. 


Table 5.3 MKM Compensator Feedback Gains. 




FEEDBACK GAINS 


DESIGN 

Xi-tO-Ui 

(N/m) 

Xi-tO-Ui 

(N/m/sec) 

X2-tO-U2 

(N/m) 

X2-tO-U2 

(N/m/sec) 

Case 1 MR 

25.4 

7.30 

91.8 

5.24 

Case 1 SR 

38.0 

8.96 

44.5 

4.13 

Case 2 MR 

24.6 

7.19 

20.9 

2.53 

Case 2 SR 

34.9 

8.58 

11.1 

2.06 

Case 3 MR 

36.0 

8.60 

160. 

6.58 

Case 3 SR 

39.7 

9.07 

140. 

6.20 


§5.3 Steady-State Response to Process Noise. We shall use the steady-state 
root-mean-square (RMS) closed-loop state and control responses to the process 
noise w e (t) to compare the performance of the different compensators. For a MR 
or SR compensator, let T represent the sampling period for the xi/xi-to -u control 
loop. Let P represent the number of STPs per BTP for the sampling policy, so that 
PT is the sampling period for the xi/ii-to-u control loop. Let 


A = e FT , 
a r T 

(15) 

B = I e Ft dtG , 
Jo 

a r T 

(16) 

B= 1 e Ft dtG . 
Jo 

(17) 


For the system in (6), let x(m, n) represent the analog state vector x(t) at the 
(mP+n)th sampling instant. Let u(m,n) and u(m,n) represent the analog control 
inputs u(t) and u (f), respectively at the (mP+n) th sampling instant. Let u/(m, n) 
represent the effect of the analog white noise t v(t) that occurs between the (mP+n)th 
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and (mP-f n+l)th sampling instants on x(t) at the (mP-f-n4-l)th sampling instant; 
that is, let 

. /•(fflP+B+l)!' 

W(m, n)= e F((mP+n+l)T-t) ^ ^ _ (l 8 ) 

J (mP+n)T 

The closed-loop state responses to the analog white noise w(t ) then satisfy 

x(m,n+ 1) = Ax(m,n) + B u(m, n) -f B u(m, n) + w(m,n) , (19) 

for m=0, 1, ... and n = 0, 1, P— 1. 

The control inputs u(m,n) and u(m,n) are assumed to satisfy 

u(m,n) = — C z(m, 0) , (20) 

u(m, n) = — C(n) x(m, n) — c(n) u(m, n) . (21) 

Let I represent am identity matrix with the same number of rows and columns as 
there are elements in x(m,n). Let 

*( 0 ) = /, 

$(1) = [A - B 0(0)1 $(0) -BC + B c(0) C , 

$(2) = [A - B C(l)] $(1) -BC + B c(l) C , (22) 

$(P) = [A-BC(P-l)]$(P-l)-BC + Bc(P-l)C. 

Let 

r(i) = /» 

r(2) = [(A-ic(i))r(i) /], 

r(3) = [(4-BC(2))r(2) /] , (23) 


r(p) = (fyi- pc(p-i))r(p-i) /]. 
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Let 


tZ>(m,0) = iw(m,0) , 

tn(m,0) 
tw(m,l)J 


tl)(m, 1) = 


w(m,P-l) = 


u/(m,0) 
w(m, 1) 


(24) 


Lto(m,P-l)J 

From (19), substituting for u(m, n) using (20), and for u(m, n) using (21), and using 
(22), (23), and (24), we obtain 

x(m, l) = $(l) x(m,0) 4- T(l) ti>(m,0) , 
x(m, 2) = $(2) x(m, 0) -f- T(2) tZ/(m, l) , 

(25) 


x(m+l,0) = $(P) x(m,0) + T(P) tZ/(m, P— 1) 
From the last equation in (25), using 

E{x(m,0) w T (m,P— 1)} = 0, 


(26) 


we obtain 


E{x(m+1,0) x T (m+l,0)} = $(P) E{x(m,0) x T (m,0)} $ T (P) 

+ T(P) E{tD(m, P-1) tZ ; T (m, P-1)} T T (P) . (27) 


Let 


X(m,n) = E{x(m,n) x T (m,n)} , 

(28) 

W'(n) = E{u;(m, n) w T (m,n )} . 

(29) 


From (27), using (28) and (29), we obtain 

X(m+1,0) = $(P) X(m,0) $ T (P) + T(P) W{P- 1) T t (P) . 


(30) 
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Assuming that the closed-loop system is stable, the unique steady-state solution to 
(30) is easily determined by setting X(m+l f 0) = X{m,Q) and solving the resulting 
set of simultaneous linear equations for the elements of Xfm , 0). Let jf(0) represent 
this solution. The matrix XfO) is the steady-state closed-loop state covariance in 
response to the analog white noise u/(t) at the first sampling instant in a BTP. Let 
Xfl), X(2 ), . . . , X(P-l) represent the corresponding steady-state state covariances 
at the other P-1 sampling instants in a BTP. From (23), using (28), (29), and (31), 
we obtain 

x(i) = *(i) *(o) * T (i) + r(i) Wfo) r T (i) , 

X(2) = $(2) X(0) $ r (2) + r(2) VF(1) r T (2) , 

(3!) 

x(P- 1) = *(P- 1) x (o) $ T (P- 1) + r(P- 1) W(p- 2) r T (P- 1) . 

The first 4 diagonal elements of X(n) are the steady-state variances of the 
analog states *i(<), *i(f), x* ft), and x? ft), respectively, in response to the analog 
process noise tn e (<), at the nth sampling instant in a BTP. JVom (20), the 

corresponding steady-state variance of the control input aft) is 

lira E{8 2 (m, n)} = C XfO) C r . (32) 

ft% • • OO 

From (21), using (25), (30), and (31), the corresponding steady-state variance of 
the control input u(t) at the nth sampling instant in a BTP is 

E{“ 2 ( m > n )} = <?(») •*(») <?*(») - Cfn) $(n) Jf(0) C J cfn) 

- (<7(n) «(n) X(0) C* c(n)) T + c(n) C X(Q) CT cfn) . (33) 

§5.4 Performance Comparison*. The performance of the Case 1 MR 
compensator is compared with that of the Case 1 SR compensator in Figure 5.9. 
The numerator and denominator values above each bar are the steady-state RMS 
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closed-loop responses to the process noise u> e (t) with the MR and SR compensators, 
respectively, in units of meters for x\ and X 2 , meters/second for zj and X 2 , and 
newtons for ui and « 2 *. Each bar in the figure has a height equal to the value of 
the ratio above it. 

The performance of the Case 1 MR compensator is markedly better than that 
of the Case 1 SR compensator. The steady-state RMS x\ (m, n) and ii (m, n) 
responses are about the same with the two compensators, while the steady-state 
RMS X 2 (m, n) and Z 2 (m, n) responses with the MR compensator are markedly 
reduced. Furthermore, the steady-state RMS control activities are less with the 
MR compensator. 

The same results for the Case 2 MR and SR compensators are plotted in the 
same manner in Figure 5.10. Comparing the Case 2 responses with the Case 1 
responses, we see markedly similar patterns in the steady-state RMS response 
ratios. Evidently, for this system, under these conditions, the performance benefits 
of MR compensation over SR compensation are markedly insensitive to the spectral 
separation of the closed-loop poles. 

The same results for the Case 3 MR and SR compensators are plotted in the 
same manner in Figure 5.11. Comparing the Case 3 responses with the Case 1 
responses, we see markedly different patterns in the steady-state RMS response 
ratios. Evidently, for this system, under these conditions, the performance benefits 
of MR compensation over SR compensation decrease with increasing sampling rates. 
This is not surprising, however, since the corresponding steady-state RMS responses 

* For a SR compensator, we define the steady-state RMS response to be the 
square root of the steady-state variance at the sampling instants. For a MR 
compensator, we define the steady-state RMS response to be the square root of 
the mean of the steady-state variances at the P sampling instants in a BTP. 
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C\! 



State or Control Variable 

Figure 5.9 Ratios of Steady-State RMS Responses to Process 
Noise with Case 1 Compensators. 
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Figure 5.10 Ratios of Steady-State RMS Responses to Process 
Noise with Case 2 Compensators. 
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Figure 5.11 Ratios of Steady State RMS Responses to Process 
Noise with Case 3 Compensators. 
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will be identical with MR and SR compensators designed in this way with very fast 
sampling rates. 

§5.5 Summary and Discussion. This section contains two subsections. The 
first presents the basic results of the MKM design studies. In the second, we take 
a second look at the use of other synthesis methods. 

Basic Results. We dealt with the simple MKM system in Figure 5.1. 
With the attenuation of the system’s responses to the process noise w c (t) as 
the performance objective, we experimented with different design conditions to 
determine circumstances under which a MR compensator outperforms a comparable 
SR compensator. 

Three design cases were considered. The successive loop closures synthesis 
method was used to synthesize one MR compensator and one SR compensator 
for each design case. For each SR compensator, the sampling rate was picked to 
be a multiple of the characteristic frequency of the fastest desired s-plane closed- 
loop poles. For each MR compensator, the sampling rate for each control loop 
was picked to be a multiple of the characteristic frequency of the desired s-plane 
closed-loop poles most coupled to that specific loop. Furthermore, for each design 
case, the sampling rates were picked such that the computation load for real-time 
operation of the MR compensator is the same as that for real-time operation of the 
SR compensator. 

The process noise w c (t) was modeled as a stationary, zero-mean, gaussian 
random process of unit variance, with a short correlation time compared to the 
characteristic times of all closed-loop poles. The steady-state RMS state and control 
responses to w c (t) were determined with the different compensators. 

For the MKM system, under these conditions, we conclude that: 
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1) For slow sampling (characterized by SR sampling at 5 times the characteristic 
frequency in hertz of the fastest desired s-plane closed-loop poles), MR 
compensation is superior to SR compensation, for ratios of the characteristic 
frequencies of the desired s-plane closed-loop poles as low as 4-to-l. 

2) The performance benefits of MR compensation over SR compensation are 
sampling-rate dependent. At the fast sampling rates (characterized by SR 
sampling at 20 times the characteristic frequency in hertz of the fastest desired 
s-plane closed- loop poles), the relative reductions in the steady-state RMS state 
and control responses with MR as compared to SR compensation were only 
about 1/3 of those obtained at the slow sampling rates. 

The insensitivity of the performance benefits of MR compensation over SR 
compensation to the spectral separation of the closed-loop poles suggests that 
faster sampling of the x-ifii -to-u control loop at the expense of slower sampling 
of the zi/zj-to-u control loop is desirable purely because the Z 2 / Z 2 -to-u control 
loop is more directly coupled to the process noise w c (t). Figure 5.12 presents 
further evidence to this effect. The steady-state RMS state and control responses 
in Figure 5.12 were obtained with the Case 1 MR and SR compensators, by the 
same procedure that was used to generate Figure 5.9, except that the process noise 
w c (t ) was modeled as a force acting on body A instead of body B. Under these 
conditions, the steady-state RMS X\ and Z 2 responses are 52% more and only 17% 
less, respectively, with the MR compensator. 

Use of Other Synthesis Methods. Could further improvements in performance 
be obtained if the optimal control law synthesis method or the constrained 
optimization synthesis method were used? The results in Figure 5.13 indicate 
that the answer is no. The denominator values in Figure 5.13 are the steady- 
state RMS state and control responses to w e {t) acting on body B with the Case 2 
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Xj X\ X 2 X2 fl U 


State or Control Variable 

Figure 5.12 Ratios of Steady-State RMS Responses to Process Noise 
Acting on Body A with Case 1 Compensators. 
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X\ X\ X2 X2 u tk 

State or Control Variable 


Figure 5.13 Ratios of Steady-State RMS Response to Process Noise 
with Optimal MR and Case 2 MR Compensators. 
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MR compensator. The numerator values are the corresponding steady-state RMS 
state and control responses with a MR compensator synthesized using the optimal 
control law synthesis method of Section 3.2. The sampling rates for the optimal 
compensator were 8 samples/second for the xi/xj/x 2 /x 2 -to-u control loop, and 
32 samples/second for the xi/xi/x 2 /x 2 /u-to-u control loop. These are the same 
sampling rates that were used in the Case 2 MR compensator, except that the 
optimal MR compensator uses a full state feedback control law for each control 
loop. 

For the optimal compensator performance index, we chose 
roo 

J = / flu x\ (t) + $22 A (t) + rn u 2 (t) + r 2 2 u 2 (t) dt . (34) 

Jo 

We varied qn, rn, and f 22 to obtain steady-state RMS closed-loop state 

responses to w c (t ) that were less than those obtained with the Case 2 MR 
compensator, for the same steady-state RMS closed-loop control activities. The 
best results were obtained with 

roo 

J= 10xJ(f) +400 xl{t) +0.014 u 2 (t) +0.1 u 2 {t)dt. (35) 

Jo 

The corresponding optimal MR control laws are 

u(m, n) = — C x(m, 0) , (36) 

u(m, n) = — C{n) x(m,n) — c(n) u(m, n) , (37) 

for m = 0, 1, . . . and n = 0, 1, . . . , 3, where 

C = [ 16.6 5.75 4.94 -0.126], (38) 

C(0) = [ 1.92 0.641 24.9 2.41], 

C(l) = [0.335 0.0881 24.3 2.42], 

C(2) = [0.390 0.121 24.3 2.41], 

C(3) = [0.890 0.309 24.6 2.42], 


( 39 ) 
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c(0) =0, 
c(l) = -0.0965 , 
c( 2) = -0.0877 , 


(40) 


c(3) = -0.0529. 

The presence of the xi/xi/u-to-u and X 2 /x 2 -to -u cross-feed terms in the optimal 
MR control laws implies that the computation load for real-time operation of the 
optimal MR compensator is more than twice that for real-time operation of the 
Case 2 MR compensator. In the light of this, the 13 and 14% reductions in the 
steady-state RMS x\ and i\ responses in Figure 5.12 do not represent a significant 
improvement in performance. 

Finally, given the small reductions in the x\ and xi responses in Figure 5.12, 
it would be pointless to apply the constrained optimization synthesis method of 
Chapter 4 to this problem, because the reductions in the steady-state RMS xi, 
xi, X 2 , and X 2 responses with a compensator synthesized using the constrained 
optimization synthesis method will be less (for the same steady-state RMS control 
activities) than those obtained with the optimal MR compensator. 




Chapter 6 


Two Link Robot Arm Design Example 


In this chapter we deal with an example design problem involving a two 
link robot arm (TLA). The open-loop system is described in Section 6.1. The 
compensator design work is described in Section 6.2. Performance comparisons; 
for the different compensators are presented in Section 6.3. Section 6.4 presents a 
summary and discussion of the important results. 


§6.1 Open-Loop System Description. The open-loop system is shown in 
Figure 6.1. It is a simplified model of an experimental arm studied by Chiang 
(1986). Point O is fixed and the two links are rigid. The axes of the rotational joints 
located at the. root and wrist are parallel, and are oriented so that all motions are 
in a horizontal plane. Reference line R is fixed in the plane of motion and passes 
through point O. Generalized coordinate 6 is the angle of rotation of the first link 
with respect to R. Generalized coordinate <5 is the distance from the tip of the 
manipulator to R. The wrist angle <j> is a redundant coordinate. The root angle 
8 and the tip position 6 are measured, and the measurements are assumed to be 
noise-free. Control inputs ui and u-i are motor torques acting at the root and wrist, 
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respectively. 

A linear state equation that describes the motions of this system for small 6 
and small 6 is derived in Appendix A. Let M and L represent the mass per unit 
length and the length, respectively, of the first link. Let m and l represent the 
corresponding quantities for the second link. The analog state equation is 

p{t) = F p(t) + G u(t) , (1) 


where 


p(t) = !«(() e(t) Ht) «Wf. 


Ul(t) 

u 2 (0I t 

•o 

1 

0 0 

'1 

0 

0 

0 0 

0 

0 

0 1 


.0 

0 

0 0 

ij 


- 0 

0 • 


1 

a 

-b 


e 

0 

0 



c 

d . 



a- -ml , 

6 = -ml 2 (21 + 2 L ) , 
6 

c = -mLl 3 , 

6 


( 2 ) 

(3) 

(4) 

(5) 

(6) 

(7) 

( 8 ) 
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d = \mi 2 [ZL 2 + LI) + lML 3 l , (9) 

6 3 

e = -MmL 3 / 3 + — m 2 L 2 / 4 . (10) 

9 12 v ’ 


Table 6.1 TLA System Parameters. 


PARAMETER 

VALUE 

M 

1.28 kg/m 

L 

0.965 m 

m 

0.977 kg/m 

l 

0.167 m 

«1 MAX 

1.42 N-m 

MAX 

0.170 N-m 


The values for M, L, m, and l, and for |ui| MAX and |u 2 |max. 
motor torques at the root and wrist, respectively, are in Table 6.1. 
values for the experimental arm reported by Chiang (1986). 

§6.2 Compensator Designs. This section describes the compensator design work. 
The coverage is is in 5 subsections, although, in practice, the design process is not 
so conveniently separable. The subsections describe the performance objectives, 
the compensator structure, the sampling policies, the specific design cases, and the 
synthesis of the different compensators. 

Performance Objectives. The performance objective was to obtain the fastest 
possible responses to tip positioning co mm ands. This was to be accomplished using 
reasonable levels of control, and the real-time computation load was to be as low 
as possible. 

Compensator Structure. The compensator structure that we chose is shown 
in Figure 6.2. It is a double lead network with cross-feed terms. The symbol z~ l 
represents a one-sample delay. The symbol ZOH represents represents a zero-order 


the maximum 
These are the 




80 


6. Two Link Robot Arm Design Example 


hold. The sampling period for 8 and ui is T. The sampling period for 6 and ui is 
P T , where P is a positive, nonzero integer. The synthesis problem is to choose the 
compensator parameters a,, /3,-y, and *y for i,j = 1,2. 



Sampling Policies. For sampling rates selection, we first expressed the 
performance objectives in terms of the desired locations for the closed-loop poles in 
the s-plane. We picked the sampling rates for 9, u\, 6 and U 2 based on assumptions 
regarding the coupling of the closed-loop 9, ui, 6, and U 2 responses to the closed- 
loop poles. The purpose of the wrist member (i.e., the combination of the wrist 
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motor and the second link) is to compensate for the low-bandwidth control at the 
root with relatively high-bandwidth control at the wrist (Chiang, 1986). Thus, 
the 0 and u\ responses will be primarily coupled to the low frequency closed-loop 
poles, and the 6 and U 2 responses will be primarily coupled to the high frequency 
closed-loop poles. 

The following subsection describes the specific design cases that we considered. 
One MR compensator and one SR compensator were designed for each design case. 
Let S s r represent the sampling rate for a SR compensator. Let S MR1 represent 
the sampling rate for 6 and ui for a MR compensator. Let S MR2 represent the 
sampling rate for 6 and U 2 for the same MR compensator. For real-time operation 
of either compensator, the number of multiplications per ui update is the same as 
the number of multiplications per u 2 update. Consequently, the MR compensator 
will require the same average number of machine operations per unit time as the 
SR compensator if S MR1 , S MR2 , and S SR satisfy 

SmRI + ^MR2 = 2 5s R . (11) 

For each design case, we picked S SR such that 

■S'sR = &SR /cL2 ) (12) 

where / C L 2 represents the characteristic frequency in hertz of the high-frequency 
desired s-plane closed- loop poles, and fc SR was either 5 (for a slow-sampling-rates 
case) or 20 (for a fast-sampling-rates case). For the same design case, we picked 
Suri and <S'mr 2 using 

<Smri = &mr /cli and *Smr2 = ^mr /cL2 j (13) 

where fc MR is a constant, and / CL1 and / c L 2 represent the characteristic frequencies 
in hertz of the low-frequency and high-frequency desired s-plane closed-loop poles, 
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respectively. To ensure that the computation loads for real-time operation of the 
two compensators are the same, we picked k MR (and thus S M ri and S MR3 ) such the 
(11) is satisfied. 

Design Cases. Tables 6.2 and 6.3 describe in detail the specific design cases that 
we considered. There are three cases in ail. One MR and one SR compensator were 
designed for each design case. Table 6.2 lists the values of all fixed parameters. 
The case dependent parameters are in Table 6.3. The symbols / and f denote a 
natural frequency and a damping ratio, respectively, with the subscripts OL or CL 
indicating open-loop or closed-loop, respectively, and the trailing 1 or 2 indicating 
association with low frequency or high frequency poles, respectively. The parameter 
S s r is the sampling rate for a SR compensator. The parameter S MR1 is the sampling 
rate for 9 and ui for a MR compensator. The parameter S MR2 is the sampling rate 
for 6 and U 2 for a MR compensator. 

Table 6.2 Fixed TLA Design Parameters. 


PARAMETER 

VALUE 

/OLI 

0 hertz 

Soli 

0 

?OL2 

0 

/dll 

0.5 hertz 

$CL1 

l/v/2 

£CL2 

1/V2 


For Design Case 1, the desired s-plane closed-loop poles are critically damped 
and have characteristic frequencies of 0.5 and 4 hertz. For the SR compensator, we 
picked S S r using (12) at 20 samples/second, or 5 times the characteristic frequency 
of the high frequency desired s-plane closed- loop poles. For the MR compensator, 
we picked S M ri and S MR2 using (11) and (13) at 4.45 and 35.6 samples/second, 
respectively, or 8.89 times the characteristic frequencies of the low frequency and 
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Table 6.3 Variable TLA Design Parameters. 




NUMERIC VALUE 

PARAMETER 

UNITS 

Case 1 

Case 2 

Case 3 

/cLa/ fcLl 

— 

8 

4 

8 

Smrz/ Sum 

— 

8 

4 

8 

Ssr/ fcvi 

samples /cycle 

5 

5 

20 

SuR2 / Ssk 

— 

1.78 

1.6 

1.78 


high frequency desired s-plane closed-loop poles, respectively. 

Design Case 2 is the same as Case 1, except that the characteristic frequency 
of the high frequency desired s-plane closed-loop poles is 2 hertz. For the SR 
compensator, we picked S s R using (12) at 10 samples/second, or 5 times the 
characteristic frequency of the high frequency desired s-plane closed-loop poles. 
For the MR compensator, we picked S MR1 and S MR2 using (11) and (13) at 4 and 
16 samples/second, respectively, or 8 times the characteristic frequencies of the low 
frequency and high frequency desired s-plane closed-loop poles, respectively. 

Design Case 3 is the same as Case 1, except that all sampling rates are 
increased by a factor of 4. For the SR compensator, we picked 5 SR using (12) at 
80 samples/second, or 20 times the characteristic frequency of the high frequency 
desired s-plane closed-loop poles. For the MR compensator, we picked S MR1 and 
S MR2 using (11) and (13) at 17.8 and 142 samples/second, respectively, or 35.6 
times the characteristic frequencies of the low frequency and high frequency desired 
s-plane closed-loop poles, respectively. 

Synthesis. With ten compensator parameters to determine, including four cross- 
feed terms, the compensator structure in Figure 6.2 is complicated enough that it 
is difficult to apply the successive loop closures synthesis method of Section 3.1. 
Furthermore, because the compensator structure in Figure 6.2 has a reduced 
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dynamic order (i.e., a dynamic order that is less than that of the plant), the optimal 
control law synthesis method of Section 3.2 cannot be applied. For synthesis, we 
used the constrained optimization synthesis method of Chapter 4 because it easily 
handles the compensator structure in Figure 6.2. 

The constrained optimization synthesis method determines a feedback control 
law that minimizes a performance index that is a quadratic sum of the state and 
control responses to a prescribed process noise. It is the user’s responsibility to 
determine a suitable model for this noise; the method requires only that it takes 
the form of a periodically stationary, zero-mean, gaussian, purely random input 
sequence. Following Schmidt’s suggestion (1985), from his work on a one-link 
version of the Chiang arm, we used disturbance torques acting at the root and 
wrist actuators to model the process noise. Let 

w(t) = [u/i(t) W2(t) ] , (14) 


where u/i(t) and W 2 (t) are the disturbance torques acting at the root and wrist 
actuators, respectively. The torques w\(t) and W 2 (t) are assumed to be mutually 
uncorrelated, stationary, zero-mean, gaussian white noise processes of intensities 
W\ and W 2 , respectively, so that 


E{u>(t) io T (r)} = W S(t-r ) , 


(15) 


where £(•) is the Dirac delta function, and 

Adding the process noise w(t) to the state model of the analog plant in (1), we 
obtain 



W = 


Wi 0 

0 W 2 


p(t) = Fp(t) + G u(t) + G w(t ) . 


(17) 
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Let p(m, n) represent the state of the analog plant p(t) in (17) at the (mP-l-n)th 
sampling instant. Let ci(m,n), C 2 (m,n), ui(m,n), U 2 i(m,n), U 22 (”»,n), u c i(m,n), 
and u e 2 (m, n) represent the signals so labeled in Figure 6.2 at the (mP + n)th 
sampling instant. Let h\(m,n) and (m,n) represent the states of the zero-order 
holds for ui (m,n) and U 2 i(m, n), respectively, in Figure 6.2, at the (mP-f-n)th 
sampling instant. Let w(m,n) represent the effect on p(t) at the (mP + n + l)th 
sampling instant of the process noise that occurs between the (mP-f-n)th and 
(mP+n+ l)th sampling instants; that is let 

A f(mP+n+l)r 

tu(m, n) = / e F ^ mP+n+1 ^ T ~^G w(t) dt . (18) 

J{mP+n)T 

Let 

A = e FT , (19) 

B= f e Ft dt G , (20) 

Jo 

and let B\ and Bi represent the first and second columns, respectively, of B. Let 
I p represent an identity matix with the same number of rows and columns as there 
are elements in p(t). Then, for the closed-loop system made up of the analog plant 
in (17) plus the compensator in Figure 6.2, the responses to w(t) satisfy 

x(m,n+l) = -A(n) z(m,n) + B(n) u(m,n) + B w w(m,n) , (21) 

with 

u(m,n) = —C x(m,n) , (22) 

for m = 0, 1, ... and n = 0, 1, . . . , P — 1, where 

z(m, n) = [p T (m, n) hi(m,n) fi 2 [m,n) ci(m,n) C 2 (m,n)] T , (23) 

u(m,n) = [ui(m,n) U 2 i(m,n) U 22 (m>rt) u c i(m,n) u C 2 (m,n)] T , (24) 

<r-2- 
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(30) 


If P = 1 the compensator in Figure 6.2 is SR. In this case, the formulation in 
(21) through (30) simplifies to 


x(m+l,0) = .4(0) x(m,0) + B( 0) u(m,0) + B w u>(m,0) , (31) 


with 


u(m,0) = —C x(m, 0) , 


(32) 


for m = 0, 1, . . . , where 


x(m,0) = [p T (m,0) 


ci(m,0) c 2 (m, 0) ] T , 


u(m,0) == [ui(m,0) 
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(34) 


(35) 


(36) 
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( 38 ) 
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The key point in each of these formulations is that the compensator parameters 
appear exclusively as elements of the state feedback gain matrix C. The constrained 
optimization synthesis method of Chapter 4 can consequently be used. We used the 
constrained optimization synthesis method and applied the AMS computer program 
to determine values for the compensator parameters a t -, /? t y, and -fry, for i,j = 1,2, 
that minimized a performance index of the form 


Jss= lim J{N ), 

N—*oo 


(39) 


where 


E i2NPT Jo 


NPT r 


P(<) 

L«(0J 


IT 


Q o 

0 R 


i "Wl *}. 
L*WJ > 


(40) 


The discretization procedures of Sections 2.1 and 2.2 are part of the AMS 
package. For each optimization, the discretization procedures were called first to 
solve for the discrete state model of the plant, the covariance of the stationary, zero- 
mean, gaussian, purely random input sequence i v(m,n), and the discrete equivalent 
to the analog performance index, given the sampling rates, the analog state model 
of the plant, the compensator structure, and the synthesis parmeters , W 2 , Q, 
and R. 

Because each optimization requires a gradient search to determine the 
compensator parameters, a considerable effort went into determining reasonable 
values for Wi, W 2 , Q, and R -prior to the first optimization for each design case. 
For the process noise levels W\ and W 2 , we picked values such that 

Mmax 


Wi 

W 2 


1 u 2|max 


(41) 


where the values for |ui| MAX and (i^Imax were obtained from Table 6.1. For Q and 
R, we used an approach suggested by Parsons (1982) and substituted values from 
analog linear quadratic regulator designs that obtained analog closed-loop poles that 
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matched the appropriate set of desired s-plane closed-loop poles from Tables 6.2 and 
6.3. 

For the analog regulator designs, we used a performance index identical to J s s 
in (39). We constrained the performance index weighting matrices Q and R to be 
diagonal. We constrained the Q 2 and <5 2 elements of Q to be zero. Let R\ and R-i 
represent the u 2 (f) and u^f) elements, respectively, of R. Let Qg and Qg represent 
the 6 2 and 6 2 elements, respectively, of Q. For R\ and R^, we picked values such 
that 

•^1 _ l/l u i Imax / 49 \ 

R , 1/!“2|max ’ 1 j 

where the values for |ui| MAX and |u2|max were obtained from Table 6.1. For Qg 

and Qg, we used trial-and-error to determine values for each design case such that 

the closed-loop analog regulator poles matched appropriate set of desired s-plane 

closed-loop poles from Tables 6.2 and 6.3. 


Table 6.4 TLA Synthesis Parameters. 




NUMERIC VALUE 

PARAMETER 

UNITS 

Case 1 

Case 2 

Case 3 

Wi 

(N-m) 2 

69.4 

69.4 

69.4 

w 2 

(N-m) 2 

1 . 

1 . 

1 . 

Qe 

— 

21. 

21.3 

21. 

Qs 

m -2 

1850. 

115. 

1850. 

Ri 

(N-m)“ 2 

1 . 

1 . 

1 . 

R2 

(N-m) -2 

69.4 

69.4 

69.4 


The final values for the synthesis parameters for the three design cases are in 
Table 6.4. For the MR compensators, the performance index weighting on v, 2 (t) 
was handled in a special way. From Figure 6.2, if P ^ 1 the analog control U 2 (f) is 
the sum of a slow-rate component U 2 i(t) and a fast-rate component U 22 ( 0 - In this 
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case, it is convenient to separate «2 {t) into these components at the analog-model 
level. The equivalent R element is then a 2-by-2 block, with R 2 at every position, 
since 


u 2 (t) = u 2 i(t) +U 22 W 

=>• u 2 {t) R 2 u 2 (t) 


*21 (0 

T 

'R 2 

R 2 

« 2 l (0 

.*22 (t) 


r 2 

r 2 

*22 (*). 


The corresponding solutions for the compensator parameters are in Tables 6.5 


through 6.7. The peformance characteristics of these compensators are compared 


in the following section. 

Table 6.5 TLA Compensator Parameters for Caise 1. 




NUMERIC VALUE 

PARAMETER 

UNITS 

MR 

SR 

0=1 

1 

0.485 

0.618 

0n 

N-m 

11.3 

60.7 

012 

N 

0.393 

7.81 . 

111 

N-m 

-13.5 

-91.7 

712 

N 

1.07 

-13.3 

0=2 

— 

0.553 

0.687 

021 

N-m 

0.0976 

0.559 

022 

N 

13.4 

7.04 

721 

N-m 

-0.121 

-0.849 

722 

N 

-16.9 

-9.13 


Figure 6.3 is a z-plane plot of the closed-loop BTP poles (see Section 2.2 for 
the definition of a closed-loop BTP pole) with the Caise 1 MR compensator. The 
□s are the e aPT transformations of the desired s-plane closed-loop poles. The xs 
are the actual closed-loop BTP poles. The two real xs are the compensator poles. 
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Table 6.6 TLA Compensator Parameters for Case 2. 





NUMERIC VALUE 

PARAMETER 

UNITS 

MR 

SR 

<*i 

— 

0.332 

0.625 

flu 

N-m 

8.75 

29.3 

012 

N 

0.970 

4.78 

7ll 

N-m 

-9.13 

-42.1 

712 

N 

-0.192 

-7.22 

<*2 

— 

0.577 

0.684 

021 

N-m 

0.0527 

0.234 

022 

N 

3.03 

1.78 

721 

N-m 

-0.0695 

-0.348 

722 

N 

-3.83 

-2.30 


Table 6.7 TLA Compensator Parameters for Case 3. 




NUMERIC VALUE 

PARAMETER 

UNITS 

MR 

SR 

C*1 

— 

0.0705 

0.373 

0u 

N-m 

37.2 

213. 

012 

N 

8.05 

23.6 

711 

N-m 

-36.0 

-287. 

712 

N 

-8.05 

-35.5 

a 2 

— 

0.354 

0.412 

021 

N-m 

0.327 

1.94 

022 

N 

54.0 

30.7 

721 

N-m 

-0.323 

-2.63 

722 

N 

-67.4 

-38.2 
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Since pole assignment is not the objective of the constrained optimization 
synthesis method, an exact match of the desired and actual closed-loop poles is not 
expected. It is encouraging, however, that the low frequency complex-conjugate 
closed-loop BTP poles in Figure 6.3 are close to their desired locations. 

But the BTP poles in Figure 6.3 are a poor indicator of the system’s high 
frequency behavior because the BTP is large compared to the characteristic times 
of the high frequency closed- loop poles. Figure 6.4 provides some indication of this 
high frequency behavior. The sampling rate for Figure 6.4 is the fast 1/T sampling 
rate for the Case 1 MR compensator. The Ds are the e aT transformations of the 
high frequency desired s-plane closed-loop poles for Case 1. The xs are the actual 
closed-loop poles with just the £-to-tt 2 tip controller portion of the Case 1 MR 
compensator (i.e., with the Case 1 MR compensator, but with 07 , /?n, /?i 2 , /? 2 i» 
7 n, 7 i 2 > and 721 set to zero). The real x in the left half plane is the pole associated 
with the tip controller portion of the Case 1 MR compensator. 

Figure 6.5 is the corresponding z-plane plot of the closed-loop poles for the 
Case 1 SR compensator. The Ds are the e sT transformations of the desired s-plane 
closed-loop poles. The xs are the actual closed-loop poles. The two real xs are the 
compensator poles. 

For completeness, the z-plane plots of the closed-loop poles for the Case 2 and 
3 compensators are shown in Figures 6.6 through 6.11. 

§6.3 Performance Comparisons. The performance comparisons in this section 
are based on the closed-loop responses to a reference tip positioning command. The 
servo configuration that we chose is in Figure 6.12. The command input is S c (t), 
in meters. The feed-forward operator l/(L+l) generates a 0 command that yields 
a (nearly) zero steady-state wrist angle, for any steady-state 6 C value that is small 
compared to L+l. 
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Figure 6.3 Closed-Loop BTP Poles with Case 1 MR Compensator. 
(Sampling Rate = 4.45 Samples/Second.) 
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Real Part{js} 

Figure 6.4 Closed-Loop Poles with Tip Controller Portion of Case 1 MR 
Compensator. (Sampling Rate = 35.56 Samples/Second.) 
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Figure 6.5 Closed-Loop Poles with Case 1 SR Compensator. 
(Sampling Rate = 20 Samples/Second.) 
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Figure 6.6 Closed-Loop BTP Poles with Case 2 MR Compensator. 
(Sampling Rate = 4 Samples/Second.) 
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Figure 6.7 Closed-Loop Poles with Tip Controller Portion of Case 2 MR 
Compensator. (Sampling Rate = 16 Samples/Second.) 
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Figure 6.9 Closed-Loop BTP Poles with Case 3 MR Compensator. 
(Sampling Rate = 17.8 Samples/Second.) 
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Figure 6.10 Closed-Loop Poles with Tip Controller Portion of Case 3 MR 
Compensator. (Sampling Rate = 142 Samples/Second.) 
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Real Part{z} 


Figure 6.11 Closed-Loop Poles with Case 3 SR Compensator. 
(Sampling Rate = 80 Samples/Second.) 
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The reference tip positioning command is 

0. m if t < 0 ; 

6 c {t) = 0.01(1— cos 27r/£) m if 0 < t < 1/2/; (43) 

[o.Ol m if 1/2/ < t. 

It is a 0.01 meter step command, but with the transition defined as one half of 
a cosine wave. The smooth transition avoids the impulsive control responses that 
would otherwise occur with lead compensation. For each design case, we set the 
frequency / of the cosine wave to the characteristic frequency of the high frequency 
desired s-plane closed-loop poles for that case from Table 6.3. The resulting tip 
positioning commands are shown in Figure 6.13. 



Figure 6.12 TLA Servo Configuration. 


The closed-loop responses to the Case 1 tip positioning command with the 
Case 1 MR and SR compensators are shown in Figures 6.14 through 6.18. These 
responses were obtained by simulating the nonlinear equations of motion for the 
TLA system that axe derived in Appendix A. The dot-dashed curves are the 
responses with the MR compensator. The dashed curves axe the responses with 
the SR compensator. The solid curves axe the responses with an equivalent fast- 
sampling-rate SR compensator. The fast-sampling-rate compensator has the same 
structure as the Case 1 MR and SR compensators and was synthesized using AMS 
for the same process noise levels and performance index. Its 500 samples/second 
sampling rate is so fast compared to the characteristic frequencies of the closed-loop 
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Figure 6.13 TLA Tip Positioning Commands. 
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Figure 6.14 Tip Position Responses to Case 1 Tip Positioning 
Command with Case 1 Compensators. 
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Figure 6.15 Root Torque Responses to Case 1 Tip Positioning 
Command with Case 1 Compensators. 
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Figure 6.16 Wrist Torque Responses to Case 1 Tip Positioning 
Command with Case 1 Compensators. 




Root Angle 0 (Degrees) 
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Figure 6.17 Root Angle Responses to Case 1 Tip Positioning 
Co mm and with Case 1 Compensators. 




! . ' I ■< ! i 1 I I 

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 


Time (Seconds) 

Figure 6.18 Wrist Angle Responses to Case 1 Tip Positioning 
Command with Case 1 Compensators. 
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poles that the solid curves represent, in effect, the responses with the analog 
equivalent to the Case 1 MR and SR compensators. 

The performance of the Case 1 MR compensator is markedly better than that of 
the Case 1 SR compensator. In Figure 6.14, the peak overshoot of the steady-state 
8 value is 21% less with the MR compensator than with the SR compensator. In 
Figure 6.16, the delay time for the initial control response to the command input is 
44% less with the MR compensator than with the SR compensator. If the responses 
with the analog compensator are ideal, then the increase in the peak overshoot of 
the steady-state 8 value in Figure 6.14 is 56% less with the MR compensator than 
with the SR compensator. As indicated by the MR and SR control responses 
in Figures 6.15 and 6.16, the performance benefits with the MR compensator as 
compared to the SR compensator were obtained at virtually no additional cost in 
terms of the control effort required. 

The corresponding 8(t), Ui(t), and uj (t) closed-loop responses to the Case 2 
tip positioning command with the Case 2 MR and SR compensators are shown in 
Figure 6.19 throuh 6.21. The solid curves in these figures are the responses with 
a 250 samples/second SR compensator that has the same compensator structure 
as the Case 2 MR and SR compensators and was synthesized for the same process 
noise levels and performance index, so that these curves represent, in effect, the 
responses with the analog equivalent to the Case 2 MR and SR compensators. 

Figures 6.19 through 6.22 show the the (slight) effects of a factor-of-two 
reduction (compared to Case l) in the spectral separation of the closed-loop poles. 
In Figure 6.19, the peak overshoot of the steady-state <5 value is 25% less with 
the MR compensator than with the SR compensator. In Figure 6.21, the delay 
time for the initial control response to the command input is 38% less with the 
MR compensator than with the SR compensator. If the responses with the analog 
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Figure 6.19 Tip Position Responses to Case 2 Tip Positioning 
Command with Case 2 Compensators. 


- c\j 
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Figure 6.20 Root Torque Responses to Case 2 Tip Positioning 
Command with Case 2 Compensators. 



Wrist Torque «2 (Newton-Meters) 
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Figure 6.21 Wrist Torque Responses to Case 2 Tip Positioning 
Command with Case 2 Compensators. 




6.4 Summary and Discussion. 
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compensator are ideal, then the increase in the peak overshoot of the steady-state 
6 value in Figure 6.19 is 50% less with the MR compensator than with the SR 
compensator. As indicated by the MR and SR control responses in Figures 6.20 
and 6.21, the performance benefits with the MR compensator as compared to the 
SR compensator were obtained at virtually no additional cost in terms of the control 
effort required. 

The corresponding <5(f), ui(t), and U 2 (t) closed-loop responses to the Case 3 
tip positioning command for the Case 3 MR and SR compensators are shown in 
Figures 6.22 through 6.24. The solid curves in these figures are the responses with 
a 500 samples/second SR compensator that has the same structure as the Case 3 
MR and SR compensators and was synthesized for the same process noise levels 
and performance index, so that these curves represent, in effect, the responses with 
the analog equivalent to the Case 3 MR and SR compensators. 

Figures 6.22 through 6.24 show the effects of a factor-of-four increase (compared 
to Case 1) in all sampling rates. In Figure 6.22, the peak overshoot of the 
steady-state 6 value is only 3% less with the MR compensator than with the 
SR compensator. In Figure 6.24, the delay time for the initial control response 
to the command input is 44% less with the MR compensator than with the SR 
compensator. If the responses with the analog compensator are ideal, then the 
increase in the peak overshoot of the steady-state 6 value in Figure 6.22 is 56% less 
with the MR compensator than with the SR compensator. As indicated by the MR 
and SR control responses in Figures 6.23 and 6.24, the performance benefits with the 
MR compensator as compared to the SR compensator were obtained at virtually no 
additional cost in terms of the control effort required. But the absolute reductions 
in the delay time and the peak overshoot are so small that the performance of the 
MR compensator is, for practical purposes, the same as that of the SR compensator. 
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Figure 6.22 Tip Position Responses to Case 3 Tip Positioning 
Command with Case 3 Compensators. 
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Figure 6.23 Root Torque Responses to Case 3 Tip Positioning 
Ccommand with Case 3 Compensators. 
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Figure 6.24 Wrist Torque Responses to Case 3 Tip Positioning 
Command with Case 3 Compensators. 
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§6.4 Summary and Discussion. This section contains 3 subsections. The first 
presents a summary of the important results from Sections 6.1 through 6.3. The 
second and third take a second look at the use of the successive loop closures and 
optimal control law synthesis methods, in the light of the results from Sections 6.1 
through 6.3. 

Basic Results. We dealt with the TLA system in Figure 6.1, and the compensator 
structure in Figure 6.2. The performance objective was to obtain the fastest possible 
response to tip positioning commands. We experimented with different design 
conditions to determine circumstances under which a MR compensator out performs 
a comparable SR compensator. 

Three design cases were considered. The constrained optimization synthesis 
method was used to synthesize one MR compensator and one SR compensator 
for each design case. For each SR compensator, the sampling rate was picked at 
either 5 or 20 times the characteristic frequency in hertz of the fastest desired s- 
plane closed-loop poles. For each MR compensator, the sampling rate for each 
measurement or control variable was picked to be a multiple of the characteristic 
frequency of the desired s-plane closed-loop poles most coupled to that specific 
variable. Furthermore, for each design case, the sampling rates were picked such 
that the computation load for real-time operation of the MR compensator is the 
same as that for real-time operation of the SR compensator. 

Performance comparisons were conducted for the different compensators. The 
comparisons were based on the closed-loop responses to a reference tip positioning 
command. 

For the TLA system, under these conditions, we conclude that: 

1) For slow sampling (characterized by SR sampling at 5 times the characteristic 

frequency in hertz of the fastest desired s-plane closed-loop poles), MR 
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compensation is superior to SR compensation, for ratios of the characteristic 
frequencies of the desired s-plane closed-loop poles as low as 4-to-l. 

2) The performance benefits of MR compensation over SR compensation are 
sampling-rate dependent. At the fast sampling rates (characterized by SR 
sampling at 20 times the characteristic frequency in hertz of the fastest desired 
s-plane closed-loop poles), the performance of the MR compensator was, for 
practical purposes, the same as that of the SR compensator. 

Use of the Successive Loop Closures Synthesis Method. We stated in 
Section 6.2 that the compensator structure in Figure 6.2 is complicated enough that 
it would be difficult to apply the successive loop closures synthesis method. It would 
be easy to apply the successive loop closures synthesis method if the compensator 
cross feed terms /?i 2 , /? 2 ii In, and 721 could be neglected. The simulation results 
in Figures 6.25 through 6.27 indicate, however, that the cross-feed terms (or some 
of them) are essential for good closed-loop performance. The solid curves in these 
figures are the closed-loop responses to the Case 1 tip positioning command with 
the Case 1 MR compensator. The dashed curves are the corresponding responses 
with a MR compensator that uses the same sampling rates and was synthesized 
using AMS for the same process noise levels and performance index, but with the 
compensator cross-feed terms set to zero. 

The values for the compensator parameters for the NXF MR compensator are 
in Table 6.8. The z-plane plots for the NXF MR compensator that correspond to 
those for the Case 1 MR compensator in Figures 6.3 and 6.4 are in Figures 6.28 
and 6.29. 

The responses in Figures 6.25 through 6.27 clearly indicate that the 
compensator cross-feed terms are important for good compensator performance. 
Furthermore, for determining values for the cross-feed terms, the z-plane plots in 
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Figure 6.25 Tip Position Responses to Case 1 Tip Positioning Command 
with Case 1 MR and NXF MR Compensator. 
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Figure 6.26 Root Torque Responses to Case 1 Tip Positioning Command 
with Case 1 MR and NXF MR Compensators. 
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Figure 6.27 Wrist Torque Responses to Case 1 Tip Positioning Command 
with Case 1 MR and NXF MR Compensators. 
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Figures 6.28 and 6.29 are of no use whatsoever. This is because the cross-feed 
terms are primarily associated with the zeros of the closed-loop 6 e -to-6 transfer 
function. Unfortunately, a means for determining the locations that correspond to 
the intuitive notion of these zeros is not known, because the closed-loop system is 
time- varying. 

Table 6.8 TLA NXF MR Compensator Parameters. 


PARAMETER 

UNITS 

NUMERIC VALUE 

<* l 

— 

0.471 

fin 

N-m 

11.1 

0i2 

N 

0. 

In 

N-m 

-13.2 

112 

N 

0. 

«2 

— 

0.552 

021 

N-m 

0. 

022 

N 

13.5 

121 

N-m 

0. 

122 

N 

-16.9 


It would be difficult to apply the successive loop closures synthesis method to 
the compensator structure of Figure 6.2 directly. It may be possible to reformulate 
the design problem such that a MR compensator with acceptable cross-feed terms 
can be determined using a slightly different approach suggested by Bryson (1986). 
For the analog state equation in (1) , if we let 

u(t) = Gu(t), (44) 

we obtain 

p(t) = F p(t) + u(t) . (45) 

And the d(t) and S(t) state equations are 


0(t) = ui (t) , 


(46) 
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Figure 6.28 Closed-Loop BTP Poles with NXF MR Compensators. 
(Sampling Rate = 4.45 Samples/Second.) 
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Figure 6.29 Closed-Loop Poles with Tip Controller Portion of NXF MR 
Compensator. (Sampling Rate = 35.56 Samples/Second.) 
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6{t) = a 2 {t), (47) 

where ui(t) and u 2 (t) are the first and second elements, respectively, of tt(<) . 

The successive loop closures synthesis method could easily be used to determine 
a MR compensator for the ui (t) and u 2 (t) system in (46) and (47). We speculate 
that, with some simplifying assumptions, a MR compensator for the ui(f) and U 2 (t) 
system with adequate cross-feed could be determined from the MR compensator for 
the tli (i) and u 2 (t) system. This is a matter for further research. 

Use of the Optimal Control Law Synthesis Method. Another interesting 
topic is the consistent overshoot of the steady-state 6 value, in the responses in 
Figures 6.14, 6.19, and 6.22. For a SR system with 2 critically damped poles and 
1 zero, Franklin and Powell (Section 2.4, 1980) discuss the effect of zero location 
on peak overshoot in response to a step . command. For any real zero location 
between —1 and +1, it is shown that an overshoot always occurs and that its 
magnitude decreases with increasing sampling rate. This is entirely consistent with 
the responses in Figures 6.14, 6.19, and 6.22. The sampling rate for 6 and U 2 is 
consistently higher in the MR compensators than in the SR compensators. Thus, 
the peai overshoot of the steady-state 6 value should be consistently lower with the 
MR compensators than with the SR compensators. 

What other compensator structure could be used to reduce this overshoot? 
One possibility is to add rate sensors that measure 0 and 8. This yields a full state 
feedback compensator structure, to which optimal control law synthesis method of 
Section 3.2 can be applied. We used the optimal control law synthesis method of 
Section 3.2 to synthesize optimal compensators comparable to the Case 1 MR and 
SR compensators of Section 6.2. For the optimal SR compensator, we picked the 
same sampling rate that was used in the Case 1 SR compensator. For 6 , 0, 6 , 6, and 
U 2 sampling in the optimal MR compensator, we picked the same sampling rate that 
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was used for 6 and u 2 sampling in the Case 1 MR compensator. For «i sampling 
in the optimal MR compensator, we picked the same sampling rate that was used 
for 9 and u\ sampling in the Case 1 MR compensator. Finally, we synthesized the 
optimal MR and SR compensators using the same performance index that was used 
to synthesize the Case 1 MR and SR compensators. 

Let P represent the ratio of the fast sampling rate to the slow sampling rate 
in the optimal MR compensator. The optimal MR control laws are 


ui (m,n) = —C p(m, 0) , 

(48) 

0 

II 

'sT 

jf 

H 

3 

(49) 

U 22 (m, n) = — C(n) p(m, n) — c(n) ui(m, n) , 

(50) 


for m = 0, 1, . . . and n = 0, 1, . . . , P — 1, where ui(m,n), tt 2 i(m, ra), U 22 (»ti, n), and 


p(m,n) have the same meanings as in (21) through (30), and 

C = [2.79 1.61 0.535 0.295], (51) 

C(0) = [0.0196 0.0147 3.15 0.230], (52) 

C(l) = [-0.00734 -0.000952 3.15 0.227], (53) 

C(2) = [ -0.00819 -0.00157 3.15 0.227], (54) 

C(3) = [ -0.00930 -0.00232 3.15 0.227], (55) 

C(4) = [ -0.0102 -0.00295 3.15 0.227], (56) 

C(5) = [ -0.00978 -0.00247 3.15 0.227], (57) 

C(6) = [ -0.00620 -0.000109 3.15 0.228], (58) 

C(7) = [0.00294 0.00540 3.15 0.229], (59) 

c(0)=0., (60) 

c(l) = -0.00982, (61) 

c(2) = -0.0103, (62) 
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O? 

II 

-0.0108 , 

(63) 

c( 4) = 

-0.0112, 

(64) 

c(5) = 

-0.0108, 

(65) 

c(6) = 

-0.00915, 

(66) 

II 

-0.00557. 

(67) 


The elements of C(n) axe plotted versus n in Figure 6.30 through 6.33. The c(n) 


are plotted versus n in Figure 6.34. 

The corresponding optimal SR control laws are 

ui(m,0) = —C p(m,0) , (68) 

u 2 i(m,n)=0, (69) 

u 2 2(m,0) = — C(0)p(m,0) , (70) 

for m = 0, 1, . . . , where 

C = [4.09 1.95 -0.599 0.267], (71) 

C(0) = [0.0337 0.0180 2.17 0.192]. (72) 


The closed-loop responses to the Case 1 tip positioning command with the 
optimal MR and optimal SR compensators are shown in Figures 6.35 through 
6.37. These responses were obtained by the same simulation procedures as were 
used to obtain Figures 6.14 through 6.24. In Figures 6.35 through 6.37, the solid 
curves are the responses with the optimal MR compensator. The dashed curves are 
the responses with the optimal SR compensator. The dot-dashed curves are the 
responses with a constant gains approximation to the optimal MR compensator. 
The sampling rates for the constant gains compensator are the same as in the 
optimal MR compensator, except that the sampling rate for 6 and 6 is the same slow 
1/PT sampling rate that is used to sample only ui in the optimal MR compensator. 




C\2 (Newtons/Radian/Sccond) C\\ (Newtons/Radian) 

oorio.ooo n oor» ii nin n.mr, -0.02-0.01 o.oo o.oi 0.02 
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n 


Figure 6.30 Optimal Feedback Gain Cn(n) versus n. 



Figure 6.31 Optimal Feedback Gain C\ 2 (n) versus n. 





C\i (Newtons/Meter/Second) Ci3 (Newtons/Meter) 
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n 

Figure 6.32 Optimal Feedback Gain Ci 3 (n) versus n. 



n 

Figure 6.33 Optimal Feedback Gain Ci^n) versus n. 





c (Newtons/Newton) 

-0.010 -0.005 0.000 
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n 


Figure 6.34 Optimal Feedback Gain c(n ) versus n. 




Tip Position 6 (Motors) 

0.000 0.002 0.004 0.000 0.000 0.010 0.012 
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Figure 6.35 Tip Position Responses to Case 1 Tip Positioning Command with 
Optimal MR, Optimal SR, and Constant Gains MR Compensators. 






Hoot Torque ui (Newton-Meters) 

0.02 - 0.01 0.00 0.01 0.02 0.03 0.01 
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0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 

Time (Seconds) 


Figure 6.36 Root Torque Responses to Case 1 Tip Positioning Command with 
Optimal MR, Optimal SR, and Constant Gains MR Compensators. 


Wrist Torque U2 (Newton-Meters) 
0.010 - 0.005 0.000 0.005 
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i ; i ; i : i i \ i ; 

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 


Time (Seconds) 

Figure 6.37 Wrist Torque Responses to Case 1 Tip Positioning Command with 
Optimal MR, Optimal SR, and Constant Gains MR Compensators. 
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The constant gains compensator has the same full state feedback compensator 
structure as the optimal compensators, and it was synthesized using AMS for the 
same process noise levels and performance index. The constant gains MR control 


laws are 

ui(m,n) = —C p(m,0) , (73) 

u 2 i(m, n) = -Ci p(m, 0) , (74) 

«22 (m,n) = - C 2 p(m,n ) , (75) 

for m = 0, 1 , ... and n = 0, 1, ..., P — 1 , where 

C = [ 2.79 1.61 0.535 0.293], (76) 

Ci = [0.0201 0.0121 0. 0.], (77) 

C 2 = [0. 0. 3.16 0.228]. (78) 


From the responses in Figures 6.35 through 6.37, we conclude that: 

1) The peak overshoot of the steady-state S value is markedly less with the optimal 
MR compensator than with the Case 1 MR compensator. The same can be said 
for the optimal SR compensator as compared to the Case 1 SR compensator. 

2) The performance of the constant gains MR compensator is, for practical 
purposes, the same as that of the optimal MR compensator. That a constant 
gains MR compensator could be synthesized that is capable of performance so 
close to that of the optimal MR compensator is presumably a consequence of 
the fact that the optimal MR feedback gains Ci 3 (n) and Ci 4 (n) (in Figures 6.32 
and 6.33) are virtually independent of n. 




Chapter 7 
Concluding Remarks 


•K 


The conclusions of this research and the recommendations for further research 
are the subjects of Sections 7.1 and 7.2, respectively. 

§7.1 Conclusions. This section contains three subsections. The first deals with 
the constrained optimization synthesis method of Chapter 4. The second and third 
present the conclusions of the mass-spring-mass design study of Chapter 5 and the 
two link robot arm design study of Chapters 5 and 6. 

The Constrained Optimization Synthesis Method. The constrained 
optimization synthesis method was shown to be a powerful tool for synthesizing MR 
or SR digital compensators. The advantages of this method are: (1) the control 
laws for all control loops are synthesized simultaneously, taking full advantage of all 
cross-coupling effects; and (2) the compensator structure is arbitrary, and simple, 
low-order compensator structures are easily accomodated. The method requires a 
gradient search to determine a control law that minimizes a quadratic performance 
index. The gradients are calculated exactly, using a closed-form expression, and 
a finite-time performance index is used so that a stabilizing initial guess for the 
control laws is not required. 
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MR or SR Compensation? The performance characteristics of MR and SR 
compensators were compared in the context of the mass-spring-mass and two 
link robot arm example design problems. The comparisons were objective in 
that they involved MR and SR compensators that were designed to satisfy the 
same performance objectives and required the same average number of machine 
operations per unit time for real-time operation. We conclude that: 

1. For the slow sampling rates (characterized by SR sampling at 5 times the 
characteristic frequency in hertz of the fastest desired closed-loop poles), 
the MR compensators markedly and consistently out-performed their SR 
counterparts, for ratios of the characteristic frequencies of the desired closed- 
loop poles as low as 4-to-l. 

2. For the fast sampling rates (characterized by SR sampling at 20 times the 
characteristic frequency in hertz of the fastest desired closed-loop poles), the 
MR compensators out-performed their SR counterparts, but the performance 
benefits were much less than in the slow-sampling-rates cases. 

Which Method for MR Synthesis? We compared the successive loop closures 
synthesis method of Section 3.1, the optimal control law synthesis method of 
Section 3.2, and the constrained optimization synthesis method of Chapter 4 in the 
context of the mass-spring-mass and two link robot arm example design problems. 
We conclude that: 

1. For the mass-spring-mass system, autonomous operation of each control effector 
is adequate to obtain good closed-loop performance and the successive loop 
closures synthesis method is ideal. 

2. For the two link robot arm system, the control effectors must cooperate to 
obtain good closed-loop performance and it is difficult to apply the successive 
loop closures synthesis method. 




7.2 Recommendations for Further Research. 
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3. For the two link robot arm system, the best closed-loop responses to tip 
positioning commands were obtained with an optimal MR compensator. A 
problem with this compensator is that it is periodically time-varying. Such 
periodicity is not a prerequisite for good closed-loop performance. A time- 
invariant MR compensator with performance characteristics virtually identical 
to those of the optimal MR compensator was synthesized using the constrained 
optimization synthesis method. 

4. The advantages of the constrained optimization synthesis method were clearly 
demonstrated in that: 

1) For the two link robot arm system, the constrained optimization synthesis 
method was shown to be a good method for synthesizing a second-order 
compensator to control the tip position. 

2) For the two link robot arm system, the constrained optimization synthesis 
method was shown to be the only method suitable for synthesizing a time- 
invariant compensator with performance characteristics comparable to the 
best optimal MR compensator. 

§7.2 Recommendations for Further Research. The following subsections 
present topics for further research in 4 areas. 

Sampling Rates Selection. We chose compensator sampling rates based on the 
characteristic frequencies of the desired closed-loop poles. A better approach would 
take the performance objectives into account more directly. The need for this was 
clearly demonstrated when it was shown that, for the mass-spring-mass system, 
fast sampling of the X 2 /x 2 -to-U 2 control loop at the expense of slow sampling of the 
xi/xi-to-ui control loop is desirable purely because the X 2 /x 2 -to-U 2 loop is more 
directly coupled to the disturbance source. 

In short, MR synthesis offers the designer the flexibility to choose more than 
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one sampling rate, but the task is also greater, and more research is needed in this 
area. 

High Frequency Characteristics of MR Systems. As pointed out in 
Section 6.2, the closed-loop BTP poles of a MR system are generally a poor indicator 
of its high frequency behavior. This is because the BTP is generally large compared 
to the characteristic times of the high frequency closed-loop poles. 

The idea of Thompson, Stein, and Athans (1983) is to treat the combination of 
the control law, the analog-to-digital converter, and the digital-to-analog converter 
as an analog device, and then assess stability of the closed-loop system in the analog 
sense. This is a promising approach, but many details remain to be worked out. 

MR Discrete Approximations to Analog Compensators. For SR sampling 
there are numerous schemes for determining a discrete approximation to a 
single-input, single-output analog compensator. For MR sampling, an algorithm 
for determining a discrete approximation to a multi- input, multi-output analog 
compensator would be useful. More research is needed in this area. 

Improved Optimization Schemes. A more computationally efficient algorithm 
for solving the constrained optimization problem would utilize a simpler 
performance index for the early stages of an optimization. See Ly’s discussion (1982) 
of the optimization algorithm for the SANDY program and Sun’s discussion (1985) 
of an improved optimization algorithm for the SANDY program for additional ideas 
for research in this area. 




Appendix A 

Two Link Robot Arm Dynamical Equations 


The open-loop system is shown in Figure A.l. It is a simplified model of an 
experimental arm studied by Chiang (1986). Point O is fixed and links A and B are 
rigid. Body C is a point mass at the tip of the manipulator. The axes of rotational 
joints located at the root and wrist are parallel, and are oriented so that all motions 
are in a horizontal plane. Reference line R is fixed in the plane of motion and passes 
through point O. Generalized coordinate 9 is the angle of rotation of A with respect 
to R. Generalized coordinate <f> is the angle of rotation of B with respect to the A. 
The tip position 8 is a redundant coordinate. Control inputs uj and u<i are torques 
acting at the root and wrist, respectively. 

The full nonlinear dynamical equations for this system were determined via a 
straightforward application of Kane’s (1972) method. Let M and L represent the 
mass per unit length and the length, respectively, of A. Let m and l represent the 
mass per unit length and the length, respectively, of B. Let T represent the mass 
of C. The dynamical equations are: 

~6[\ML Z + ml(L 2 + -l 2 ) + T{L 2 + l 2 ) + (ml + 2 T)Ll cos 6} 

3 3 

+ 4>\-ml z + Tl 2 + {-ml + T)Ll cos <j>] 

3 2 
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- j> 2 [{\ml + T)Ll sin <f>\ - 6<j>[{ml + 2T)Llsin<t>] = ui , (l) 

0{-ml 3 + Tl 2 + {-ml + T)Ll cos <f>] + 4>{-ml 3 + Tl 2 ) 

3 2 3 

+ 0 2 [{^ml + T)Llsm4>] = U 2 . (2) 

4 y 

Now we assume that 6 and <p axe small enough that cos 9 = 1, sin 6 = 9, cos <f> = 1, 
and sin <f> = <f>, and that 9 and j> are small enough that terms in products of 9 and <j> 
in (l) and (2) are negligible compared to terms in 6 and 4>. From (1) and (2), we 
obtain 

'e 
e 

i> 

A 

where 


a= \mL 3 + ml{L 2 + Ll + \l 2 ) + T{L + l) 2 , (4) 

O O 

b = ^ml 3 + Tl 2 + (^ml + T)Ll , (5) 

c = b , (6) 

d = ^ ml 3 + Tl 2 . ( 7 ) 

From (3), transforming to 0 and <5 coordinates using 


-9‘ 


• 1 0 0 0- 


-0- 

0 


0 10 0 


9 

8 


L + l 0 l 0 


* 

.8. 


. 0 L + l 0 l. 


uj 


we obtain 

p(f) = Fp(t) + Gu(t) , (8) 



-0 10 0- 


-0- 


0 0 0 0 


6 


0 0 0 1 


<t> 


o 

o 

o 

o 


UJ 


+ 



■ o o ■ 

1 

( 1 1 

d -b 


«i 

\ad — be J 

0 0 


«2_ 


c a . 



(3) 


where 


p(0 = [9(i) 9(1) m 9(1) ] T , 

u(l) = [ui(l) u 2 (1)] t ', 


(9) 

( 10 ) 




141 



-oioo- 
0 0 0 0 
0 0 0 1 ’ 
.0 0 0 0 . 



0 

d 

0 

. (L + l)d - Ic 


0 
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( 11 ) 
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c 



Figure A.l Open-Loop TLA System with Tip Mass 



Appendix B 
Proofs for Theorems 1 and 2 


An open-loop plant is assumed to be represented by the time-varying discrete 
state equation 


x(t+ 1) = A(t) x{t) + J3(f) u(t) + w(t) , 


( 1 ) 


for t = t o, t o + l, . .., t\ — 1, where x(t), u(f), and u;(t) are the state, control input, 
and process noise input vectors, respectively. The initial state x(to) is assumed to 
be a zero-mean, gaussian random vector, with covariance Xq. Let 


a; * S 1 if * = J 5 

_ \o if i/y. 


(2) 


The process noise is assumed to be a zero-mean, gaussian, purely random sequence, 
with covariance W(t), so that 


E{tu(t) u; T (r)} =W{t) 6{t,r) , 


(3) 


where E{-} is the expected value operator. The process noise and initial state are 
assumed to be uncorrelated. 

The performance index is assumed to be 

A l„f -r,. , ~ V V -' [ x(t) 1 T r Q(t) N(t) 


= 2 E { a;T ( t i) 9i x (*i) + 


T—t 

< 7**1 


X ( T ) ' 

T 

u(r) 



x(r) 

u(r) 


}. w 
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where Qi is a symmetric, positive semidefinite matrix, and each Q(t) and iZ(r) is 
a symmetric, positive semidefinite matrix. 

The control input is assumed to satisfy 

u(t) = -C(t) x(t ) . (5) 

Let I x represent an identity matrix with the same number of rows and columns 
as there are elements in x(f). Let 

$(r,t) =^A(r — 1) — B(t— 1) C(t — 1)^ (^A(r — 2) — B(r — 2) C(r — 2)J* 

(6) 

for t = to, fo + 1, t\~ 1 and r = f + l, t+ 2, ..., fj, and let 

*(«,*) = /., (7) 

so that the $(r,t) satisfy 

$(r + l,t) = (^(r)-B(r) C(r))$(r,t). (8) 

Let 

o ( t) — \ 1 i T f oM *Mir i ] (9) 

Wc{t> - [-C(i)J [W T (() R(t) J -C(e) J ■ 1 ' 

Let 

A tl_1 

^(t) = $ T (*i,t)Qi $(<i,0 + $T ( r ,0 Qo(t) $(r,t) , ( 10 ) 

T=t 

1 

for t = to, to + 1) • • • , <i, so that the ^(t) satisfy 

*(f) = (A(t)-B(t)C(t)) T ^(t + l)(A(f)-B(t)C(t)) + Q c (t), (11) 
for \&(ti) = Q\. 

Theorem 1. An equivalent expression for the performance index in (4) is 

— 1 

•7(*;u(0) = -E{x T (t)*(t)x(t) + u;T ( t ) ^( T + l) tw ( r )} . (12) 

1 T=t 

t*t x 
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for < — <o, <o + l, . . . , t\ . 


Proof. From (4), using (5) and (9), we obtain 

1 <1_1 

= - E {x T (<i)Qix(t 1 ) + xT { t )Qc{t)x{t)} , (13) 

T=t 

M< 1 

for < = <o, <o + l, ..., <i. From (1), using (5), (8), and (7), we obtain 

T — 1 

x(r) = $(r,<) x{t) + Y2 #(r,M+l) »(/*) , (14) 

A*=t 

Mr 

for < = <o, <o+1j . . • , <i and r = <, <+l, . . . , t\. From (13), substituting for x(<i) and 
x(r) using (14), we obtain 

1 <i-l T 

J(<;u(-)) = -E { [$(<!,<) x(<) + ^2 *(*i,M+1)w(m)] Qi 

n=t 

M*i 

ii — 1 

* [$(<i,<)x(<) + J2 *(<i*m+i) «»(**)] 

M=f 

M*i 

tl-l T — 1 T 

+ X] [*(»■, o*(o + XI *(*■»/*+ iM/o] ^( r ) 

r=f L n=t 

M< l t^r 

T— 1 

* [$(r,<)x(<) + X^®( r »A*+l)w(l*)]}, (15) 

n=t 

Mr 

for < = <o, <o + l, . . • , <i. Most of the product terms in (15) axe zero, and we obtain 
J(<;u(-)) = jx T (<) $ T (<i,<) Qi $(<i,<) x(<) 

ti-i 

w T {n) $ T (<i,/a + l) Qi $(<i,m+ 1) u;(/t)] • 

n=t 

M< i 

«i-i 

+ [X] ® T (0 $T ( r ^)<?c(T)$(r,<)x(<)] 

T=t 

M<i 

<1 — 1 T — 1 

+ iy T (/x) ^ t (7-,/x-+ 1 ) Qo(r) ^(r^-h 1 ) io(m)] } , (16) 

T—t U=t 

Mil t^T 
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for * = *o, *o + l> • • • , *i. 

From (16), substituting for the double summation using 

ti-i t — l ti-i tx-i 

T—t fl=t fi=t T=p + 1 

*^*1 t-^T t^*l 

we obtain 


(17) 


1 * 1-1 

J(t;u(-)) = -E|x T (t) $ T (*i,*) Qi $(*i,*) + ^2 $T ( r >0 Qc{t) $(r, *)]*(*) 


T—t 

* 9 ** 1 


* 1-1 


+ £ “^(m) $ t (*i,M+ 1 )Qi*(*i,M+ 1 ) 


m=* 

* 9**1 

* 1-1 


+ 


$ T (r,/x + l)Q c (r) $(r,/x+l) w(/x)}, 


(18) 


T=J1+1 

M#*l -1 


for * = *o, *o+l) . • . , *i. And from (18), using (10), we obtain 

, *1-1 

J(*;u(-)) = -e{x t (*) $(*):e(*) + ^ u/ T (/*) ¥(/i+l) w(/*)} , 


(19) 


M=* 

* 9**1 


for * — *o > *o +* 1) •••) *!• 


Now let ui(t) = — Ci(*)x(t) and U 2 (t) = — C 2 (*)x(*) be two different control 
laws. Let 

*<(r,0 = (A(r-l)-B(r-l)C t (r-l))(A(r-2)-B(r-2)C t (r-2))* 

(A(t)-J9(t)Ci(*)), (20) 

for t = to, *o + l) • • . , *i — 1 and r = * + l, * + 2, . . . , <i, and let 

*<(*,*) = /*• ( 21 ) 


Let 



I 

T 

<?(<) 

N(t)' 

/ 



[jv T (t) 

•K(0 J 

. -c,« . 


(22) 
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Let 

a tl_1 

¥,•(<) =*7(*it0Qi*i(<i.0+ 5Z QK 7 ’’*) Qc<( r ) $i(r,t) , (23) 

T=t 

&t 1 

for t = to, to+l> •••> *i, so that the ^i(t) satisfy 

*<(*) = (A(t)-B(O C t -(0) T *<(< + 1)(A(0-B(0 C,-(t)) + Qc<(0 , (24) 

for ¥ t -(«i) = Q\. 

From Theorem 1 and the properties of the expected value operator, the 
difference in the performance index if u 2 (£) is applied instead of ui(t) is 

J ( i ;«2(-)) ~ ^;«i(0) = |E{x T (t)(«i(«) - ^(t))x(f) 

‘i-i 

+ Y (^( r + l) - ¥i(r + l))u>(r) j , (25) 

r=t 

t*h 

for t = to, to + 1, . . • , t\. 

Lemma X. The %(t) — 'J’i(t) in (25) satisfy 

*2(t)-Vi(t) = Y, $ 2( r ^){(^2(0-Ci(r)) 

T=t 

* [— iV T (r) + R(t)Ci (t) - B T (r)^i (r + 1) (i4(r) - B(r)C 2 (r)J ] 

+ [~N T (r) + R(t)Ci (r) - B r (r)ty (r + 1) A(r ) - B{t)C 2 (r)) J 

* (c 2 (t)-Ci(t)) + (c 2 (r)-C 1 (r)) T [ii:(r)-B T (7-)^(r + l)B(r)] 

* (c 2 (r)-Cx(r)) |$ 2 (’-,t) , (26) 

for t = to, to + 1, • • • , t\. 

Proof. From (24) and (22), the ^i(r) in (25) satisfy 

*i(r) = (a(t) - B(r)Ci(r) j 'l'i(r-t-l) (Air) - B(/)Ci(r)j 

+ <3W - C, T ( r)tf T (r) - JV(r)Ci(r) + C?(r)fl(r)C,(r) , (27) 
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for r = t, $ + 1, ... , ti — 1. From (27), substituting for A(t) — B(t)Ci(t) using 

A(r) - B(r)C,(r) = A(r) - B(r)C,(r) +B(r)(c,(r) - C,(r)) , (28) 

we obtain 

«k(r) = (a(t)-B(t) C 2 (r))\(r+l)(A(r)-B(r) C 2 (r)) 

+ (A(r)-S(r)C 2 (r)) T ^ 1 (r + l)B(r)(c 2 (r)-C 1 (r)) 

+ [fi(r) (C 2 (r) - C, (r)) ] T «k (r + 1) (a{t) -B(r) C 2 (r)) 

+ [B(r)(c 2 (r)-C 1 (r))] T ^(r + l)S(r)(c 2 (r)-C 1 (r)) 

+ Q(r) ~ C?(r)N T (r) - JV(r)Ci(r) + Cf(r)fl(r)C!(r) . (29) 

But, on the other hand, the ^(r) in (25) satisfy 

«i(r) = (,4(r)-B(r)C 2 (r)) T ^(r + l) (a{t)-B{t)C 2 (t)) 

+ Q(r) ~ Cj(r)iV T (r) - N(t)C 2 (t) + C?(t)R(t)C 2 (t) , (30) 

for r = $, t + 1, ..., $i — l. Subtracting (30) from (29), and using 

Cf(r)BMC 2 (r) — Ci T (r)fi(r)C,(r) = (C,W— ^(rJ^ieW^W-C^r)) 

+ (c,(r)-C,(r)) T B(r)C,(r) + C?(r)B(r)(c,(r)-C,(r)) , (31) 

we obtain 

* 2 (r)-*i(r) = (A(r)-B(r)C 2 (r)) T (^(r + l)-^(r + l))(A(r)-B(r)C 2 (r)) 

+ (c 2 (r)-C 1 (7-)) T [-JV T (r) + i?(r)C 1 (r)-B T (r)^(r+l)(A(r)-B(r)C 2 (r)) 

+ [-iV T (r)+iZ(r)Ci(r)-B T (r)^ 1 (r + l)(A(r)-B(r)C 2 (r))] T (c' 2 (r)-C 1 (r)) 
+ (c 2 (r)-C 1 (r)) T [i2(r)-B T (r)^ 1 (r + l)B(7-)] (c 2 (r) -Ci(r)) . (32) 

And (26) is the solution to (32) that satisfies the boundry condition %($i) — ($i) = 


0 . 
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Now assume that the C[t) in (5) satisfy 

M- 1 

C(0 = y^, &r{t)Cr > (33) 

r=0 

where M is a positive, nonzero integer less than or equal to ti — to, each C r is a 
constant matrix, and the a T (t) are scalar functions of t that satisfy 

a p (n) a 9 (n) = d(p,g). (34) 

Let 

(r) = —N t (t) + R{t) C(t ) - B t {t) tf(r + l) (,4(r)-B(r) C(r)) . (35) 

Theorem 2. If dJ(to]u(-))/dC r represents the matrix whose (t,j) th element 
contains the gradient of J(to\u(-)) with respect to the (*,j) th element of C r , then 

[‘f;a r (r)*(r)*(r,i„)Xo* T (r,to)] 

r=t 0 

+ [ X] a r (r)^(r)$(r,^+l)I^(/x)$ T (r,/i + l)] , (36) 

T=*0 + 1 M=*0 
< 0 ^ 1-1 

for r — 0, 1, . . . , M — 1. 

Proof. Let 

M- 1 

Ci(t)= y «.(*) ^ ( 37 ) 

i = 0 

CiW^C^+arWeA, (38) 

where M, the C,-, and the a,(t), are in accordance with (33) and (34), 0 < r < M— 1, 
e is a scalar, and A r is an arbitrary matrix with the dimensions of C T . 

From Theorem 1 and the properties of the expected value operator, the 
difference in the performance index if U 2 (i) is applied instead of ui(f) is 

« 2 (-)) ~ *J( f o; ui(-)) = -tr jxo^(to) — ^( to )) 
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where tr{-} is the trace operator. From Lemma 1, the 'fe(t) — ^(t) in (39) satisfy 
= Y ^(r,f){(c 2 (r)-C 1 (r)) 

T=t 

1 

* [~N t {t) + R(t)Ci (r) - B t (r)® i (r + 1) (a(t-) -B(t)C 2 (r)) ] 

+ [-iV T (r) + i2(r)Ci(r)-B T (r)^i(r + l)^(r)-B(r)C 2 (r))j 

* (C 2 (r)-C!(r)) + (c 2 (r)-C 1 (r)) T [l2(r)-B T (r)«i(r + l)5(r)] 

* (c 2 (r)-Ci(r)) }$ 2 (r,i) , (40) 


for t — to<, to I • • ■ ) t \ • 

Let (•),;• represent the operator that returns the (t,j) th element of its matrix 
argument. From (20) and (21), using (37) and (38), we obtain 


$ 2 (r,t) = $i(r,t) - e(^$i(r,t + l)B(i)a f (t) A r $i(i,t)) +JR(e,r,t), (41) 

i=t 

t*T 

for t — to, to+1, . • • , ti and r = t, t+1, . .., *i, where 3J(e, r,t) is a matrix all of whose 
elements satisfy 


= 0 . 

e-*0 e 


(42) 


From (40), substituting for C 2 (r) using (38) and for $ 2 (r,f) using (41), we 
obtain 


ti-l r— 1 

^(t)-^(t) = y e (E*i( T »*'+i) fl w«r(o A »- $ i (*»o) 

r—t X=t 

t?r 

+ £(e,r,t)] |^a r (r)cA r ) J-AT T (r) + i2(r)Ci(r)-B T (r)^i(r-f l) 

* ^(r)-B(r)(Ci(r) + a f (r)e A r )j + J-iV T (r) + i2(r)Ci (r) 

- 5 T (r)^i(r+l)^A(r)-B(r)(Ci(r) + a r (r)e A r )] (a r (r)fA r ) 

+ (a r (r)eA r ) [i?(r) -5 T (T)'I' 1 (r + l)B(r)] (a r (r)eA r )} 

r— 1 

+ [<&i(r,i) - e (JY $i{T,i+l)B(i)a r {i) A r $i(i,f)J +5R(e,r,t)j , (43) 

i=t 

&T 
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for t = to, io + lj . . . , <i. From (43), combining terms of second and higher order in 
e, we obtain 

<1-1 


^(0-^(0= E«rM{(o,M«A r ) 


T—t 

1 


* -N t (t) + R(t)C\{t) - -B T (r)^i(r+l) ^A(t) — B(t) Ci(r)j 
+ [-iV T (r) + R(t)Ci(t) - B t (t)^(t + 1)(^A{t)-B(t) Ci(t)^ 

* (a r (r)€ A r ^ }$i(r,i)] + SR(e,t) t (44) 


for t = to, to+l 5 • . . , h, where 0?(e,t) is a matrix all of whose elements satisfy 


(9i(e, 

lim v v ’ >h] = 0 . 

e—0 £ 


(45) 


Letting 


^(r) = ~N t (t) +R{t)Ci(t) - B T (r)^(r + l)(A(7-)-B(r)Ci(7-)) , (46) 

(44) can be written 

ti-i 

^(t)-^(f) = e [ ^2 a r (r)$^(r,f)|A^ ^(r) + «i T (r) A r }$i(r,*)] 

+ S?(€,t), (47) 


T—t 

t±tl 


for t — toj to I 1, t r • 

From (39), substituting for %(to) — ty^o) and ^(r + 1) — ^(r + l) using (23), 
we obtain 


J{to\u 2 {-)) - J(t 0 ;ui(-)) = ^tr{Xo(e a r (r)$?(r,t 0 ) 

r=t 0 

* | A^i(r) +^ T (r) A r }$i(r,t 0 )] + &(Mo)) 

+H W ’(#0(e[ ^2 a '(»W( r .M + 1 ) 

H=to T=n + 1 

H&i-l 

* | Aj¥i(r) + ty T (r) A r J$i(r,/x+l)] + D?(e, /x+1)) } • 


( 48 ) 
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From (48), substituting for the double su mm ation using 

ti-l ti-l ti- 1 r— l 

E E E E^***)* 

M=<0 T=H + 1 T=t 0 + 1 M=<0 

1-1 

and using the properties of the trace operator, and combining terms of second and 


(49) 


higher order in e, we obtain 

ti-i 

J{to\u 2 (-))-J{to',ui(-)) = trje a r (r)$i(r,t 0 )Xo$[(r,t 0 )^i T (r)j 

r- to 


fi -1 r — 1 


+ 


[E E a r (r)$i(r,/i+l)W(/z)$i ( r ,M+l)^i T (i')])^r + 3?(<0} , (50) 


r=t 0 +l H=to 
to&i-l 


where 9?(e) is a matrix all of whose elements satisfy 

«— *0 £ 


(51) 


Equation (50) is of the form 

J(*o; u a (-)) - J{hi ui(-)) = tr{e K A r + R(e) } , (52) 

where 

<1-1 

K = (E «r(r)$i(r,to)^o$?(^io)% T (r)) 

T=t 0 

+ ( 5^ c < r (’')$i(r,A<+ 1 )^(M)^i'(^M+ 1 )^ T ( 7 ')) » (53) 

r=to+l M = < o 
<0#<1-1 

and it is easy to show (let A f be a matrix of zeros except for a one at position i-j, 
then take the limit in (52) as £ — ► 0) that 

dJ[tp\ tti(Q) _ 
dC r 

<1-1 _ 

= (E M r )^M*i( r »*o)Xb$i(r,f 0 )) 

T=t 0 

‘i- 1 r-1 

+ (E E a r (r)^ 1 (r)$ 1 (r,M + l)W(^)$i( T »^‘ 1 ' 1 )) » ( 54 ) 

T=<0 + 1 P=<o 
to&l 


for r = 0, 1, . . . , Af— 1. 




Appendix C 

User’s Guide to AMS 


The three phases of AMS execution are: (1) input, (2) optimization, and 
(3) output. A summary of the three phases and a description of all input and 
output data formats are presented in the following sections. For further information, 
a listing of the AMS Fortran program will be furnished upon request. 

§C.l Optimization Phase of Execution. The optimization phase of AMS 
execution consists of a series of iterations to determine a set of feedback gains 
that minimizes the discrete performance index. An iteration consists of a linear 
search and a subsequent step in the linear search direction. For each iteration, the 
linear search direction is determined based on the value of the performance index, 
the gradient of the performance index with respect to the feedback gains, and 
the approximate Hessian matrix (which contains second derivative information). 
The linear search determines a step length that yields a set of feedback gains 
that approximately minimizes the performance index. The step is executed and 
the values for the feedback gains, performance index, gradient, and approximate 
Hessian matrix aire updated to complete the iteration. 

The iterations continue until the normalized gradient with respect to every 
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feedback gain element is less that or equal to the specified tolerance TOL. 
Specifically, if J(NN) represents the performance index and FGM(r)ij represents 
a feedback gain element, then convergence is assumed when 




( 1 ) 


for every feedback gain element ( FGM(r))ij . 

The parameters for the optimization phase fall into five catagories: (l) the 
parameters that regulate the numerical search; (2) the state model description of 
the plant; (3) the constraints on and the initial guess for the state feedback gains; 
(4) the finite time for and the weighting matrices for the performance index; (5) the 
parameters associated with the initial guess for the approximate Hessian matrix. 

The parameters that regulate the numerical search are: 

NTTBMX: The upper bound for the number of iterations. 

TOL : The tolerance parameter in (l). 

COST : The estimated lower bound for the value of the performance index. 

STEPMX : The upper bound for the step length for any linear search step. 

The state model description of the plant is 


x(m,n+l) = ASM(n) x(m,n) + BSM(n) u(m,n) + w(m,n ) , (2) 


for m = 0, 1, ... and n = l, 2, ..., IT, where x(m,n) is the iX-by-1 state vector, 
u(m, n) is the IU-by-1 control input vector, w{m,n) is the iX-by-1 process noise 
input vector, and each ASM(n) and BSM{n) is a constant matrix. To simplify the 
progr amm ing, we avoided the 7T = 1 case so that TT must be at least 2*. 

* The TT = 1 case represents SR sampling. A SR sampling policy is easily 
accommodated, however, by setting TT = 2 and stipulating that all control inputs 
are sampled at every STP. 
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The state feedback control law is 


u(m,n) = —C(n) x(m,n) , (3) 

where each C(n) is a constant matrix. Each C(n) is constrained to satisfy 

MM 

C(n) = * FGM(r) , (4) 

r=l nf 

where MM is a positive, nonzero integer less than or equal to IT, ( ALPHA), y is the 
(*,i)th element of the matrix ALPHA all the elements of which are either 1 or 0, 
and each FGM(r) is a constant matrix. 

The elements of the FGM(r) are the independent variables for the optimization. 
The (t,j)th element of FGM(r) is unconstrained or constrained to be fixed 
depending upon whether the (i,i)th element of the matrix NOGRDF(r) is 1 or 
0, respectively. 

The process noise vector rv(m,n) is assumed to be a periodically stationary, 
zero-mean, gaussian, purely random sequence with covariance GWG(n), so that 

E{tu(m,n) tu T (fc,i)} = GWG(n) * 6(mTT+n,kTT+l) , (5) 


where 


c ,... A f 1 if t = 7’; 

— { o if* ?j. 


( 6 ) 


The performance index is 


AFV— 1 TT 

^ v V 

x (m,n) 

T 

' QCST(n) 

NCST{n ) ' 

x(m, n) 

z_, 

m=f) n=1 

u(m, n) 


NCST 7 (n) 

PCST(n) 

u(m,n) 


( 7 ) 

where NN is a positive, nonzero integer, and each QCST(n), NCST(n), and 1 RCST(n) 
is a constant matrix. To simplify the programming, we avoided the NN = 1 case so 
that NN must be at least 2. 


The approximate Hessian matrix is stored in a factored form in the two vectors 
HESS and HESFAC. At the end of every run, HESS and HESFAC are saved on a 
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disk file so that they can be used as the initial guess for the approximate Hessian 
matrix in a subsequent run. The parameters for the optimization phase that are 
associated with the approximate Hessian matrix are: 

HESFIG: The logical parameter that indicates whether an initial guess for 
the approximate Hessian matrix is available. If HESFLG is true, HESS and 
HESFAC are used as the approximate Hessian matrix for the first iteration. If 
HESFIG is false, an identity matrix is used as the approximate Hessian matrix 
(i.e., a steepest decent search algorithm is used) for the first iteration. 

HESS : The lower triangular factor of the cholesky factorization of the 

approximate Hessian matrix, stored as an (N * (N — l)/2)-by-l vector, where 
N = 1U*IX*MM. 

HESFAC : The diagonal elements of the diagonal factor of the cholesky 

factorization of the approximate Hessian matrix, stored as an JV-by-1 vector, 
where N = IU*IX*MM. 

On the AMS Output File, the first section of printout from the optimization 
phase of execution is a simple echo of the parameters for the optimization phase. 
This is followed by the printout from the numerical search. The printout from 
each iteration gives the status of the numerical search immediately before the linear 
search step for that iteration is taken. This status is indicated by the values of the 
following variables: 

FGM(r ): The rth feedback gain matrix, for r = 1, 2, . . . , AIM. 

GRDF(r ): The gradient of the performance index J(NN') with respect to FGM(r), 
for r = 1, 2, . . . , MM. 

GNORM(r): The normalized gradient of the performance index J(NN ) with 
respect to FGM(r), for r = l, 2, ..., AIM. The (*,j)th element of GNORM(r ) 
contains the quantity on the left hand side of (l). 
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CONVERGENCE PARAMETER: The absolute value of the largest (in an absolute 
value sense) single element of GNORM(r), for r = 1 , 2, . . . , MM. This value 
is compared with the value of TOL after each iteration to determine whether 
convergence as defined in (1) has occurred. 

NUMBER OF COST EVALUATIONS: The number of performance index 

evaluations for the iteration. 

NUMBER OF GRADIENT EVALUATIONS: The number of gradient evaluations 
for the iteration. 

LINEAR SEARCH STEP SIZE: The step size for the linear search step for the 
iteration. 

PERCENT COST REDUCTION: The percent reduction in the value of the 
performance index for the iteration. 

The last section of the printout from the optimization phase shows the final 
statistics for the optimization. This includes a table of the final closed-loop BTP 
poles. 

Example AMS Input, Output, and Save Files are included at the end of this 
appendix. These files are from a final AMS run for the Case 1 MR compensator of 
Chapter 6. The printout from the optimization phase of execution begins on page 
7 of the example output file. 

§C.2 Input Phase of Execution. The sole purpose of the input phase of 
execution is to establish the values for the parameters for the optimization phase. 
The parameters that regulate the numerical search, the constraints on and the 
initial guess for the state feedback control law, the finite time for the performance 
index, and the parameters associated with the approximate Hessian matrix are 
read directly from the AMS Input File. The discrete state model description of the 
plant and the weighting matrices for the discrete performance index are generated 
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by discretizing the analog state model description of the plant and the analog 
performance index. 

The analog state model description of the plant is 

p(t) = F p{t) + GU u(t) + GW w{t) , (8) 

where p(f) is the IXA-by-1 state vector, u(t) is the IUA- by-1 control input vector, 
w(t) is the IWA-hy-1 process noise input vector, and F, GU , and GW are constant 
matrices. The initial state p(0) is assumed to be zero. 

The process noise vector t u(t) is assumed to be stationary, zero-mean, gaussian, 
white noise of intensity WA, so that 

E{tu(t) w T (r)} = WA * 6[t — r) , (9) 

where £(t) is the Dirac delta function. 

The STP (shortest time period) for the sampling policy is TSEC, in seconds, 
and TT is the integer number of STPs per BTP (basic time period) for the sampling 
policy. To simplify the programming, we avoided the TT = 1 case so that TT must 
be at least 2*. 

The analog control input vector u(t) is assumed to be partitioned so that 

•M-fcffi- < 10 > 

where ui(£) is the iZ7l-by-l vector that includes all control inputs that are not 
sampled at every STP, and U 2 [t) it the IU2-by-l vector that includes all control 
inputs that are sampled at every STP. The sampling schedules for the elements of 
ui(t) are defined by the TT-by-IUl switching matrix STBL. The (t',j)th element of 
* The TT = 1 case represents SR sampling. A SR sampling policy is easily 
accommodated, however, by setting TT = 2 and stipulating that all control inputs 
are sampled at every STP. 
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STBL is 1 or 0 depending upon whether the / th element of ui(f) is sampled and 
held or just held, respectively, at the start of the tth STP in a BTP. 

The analog performance index is 



where NN is a nonzero, positive integer, and QA and RA are constant matrices. To 
simplify the programming, we avoided the NN = 1 case so that NN must be at least 
2 . 

In addition to accommodating standard discretizations of an analog plant and 
an analog performance index, the AMS program is designed so that partitions can 
be added to the coefficient matrices for the discrete state model, the covariance 
matrices for the discrete process noise, and the weighting matrices for the discrete 
performance index. Such partitions can be used to model the interactions between 
the analog plant and a dynamic compensator, so that compensators of arbitrary 
structure and dynamic order can be synthesized. 

For the input phase of execution, the state vector x(m, n) for the discrete state 
model in (2) is partitioned so that 

p{m,n) 

x(m, n) = h(m,n) , (12) 

c(m,n) 

where p(m, n) is an DCA- by-1 vector, h(m,n) is an H71-by-l vector, and c(m,n) 
is an IXC- by-1 vector. Similarly, the control input input vector u(m, n) for the 
discrete state model is partitioned so that 

Ui (m, n) 

u(m, n) = U 2 (m,n) , (13) 

u c (m,n)_ 

where ui(m, n) is an iUl-by-1 vector, U 2 (m,n) is an IU2-by-l vector, and u c (m, n) 
is an IUC- by-1 vector. 
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In (12), the vector p(m,n) represents the state vector p(t) of the analog plant 
in (8) at the (m7T+n)th sampling instant. The vector h(m,n) is the state vector of 
zero-order hold states for the ui(m, n) controls in (13), so that h(m, n) represents the 
analog control input vector ui(t) in (10) at the (mTT-fn)th sampling instant. The 
vector c(m,n) is the state vector for the dynamic compensator at the (mTT+n)th 
sampling instant. 

In (13), the vector ui(m,n) is the discrete control input vector that effects the 
state vector h(m,n) in (12). The vector U 2 (m,n) represents the analog control 
input vector t*2 (t) in (10) at the (mTT+n)th sampling instant. The vector u c (m, n) 
is the discrete control input vector that effects the state vector c(m,n) in (12). 

Let IU = IU1 + IU2 + IUC. Let IX = IXA + IU1 + IXC. For the input phase 
of execution, each coefficient matrix ASM[n) for the discrete state model in (2) is 
partitioned so that 

* ASMP(n ) " 

ASM(n) = ASMH(n) , (14) 

L ASMC{n)_ 

where ASMP(n) is an IXA-hy-IX constant matrix, ASMH (n) is an IXH-by-IX 
constant matrix, and ASMC(n) is an IXC-by-IX constant matrix. Similarly, each 
coefficient matrix BSM(n ) for the discrete state model is partitioned so that 

' BSMP{n) 0 

BSM(n) = BSMH(n) 0 , (15) 

0 BSMC(n) _ 

where BSMP(n) is an IXA-by-IUA constant matrix, BSMH(n) is an IXH-by-IUA 
constant matrix, and BSMC(n) is an IXC -by- IUC constant matrix. 

The ASMC(n) partition of each ASM(n) and the BSMC(n) partition of each 
BSM(n) are read directly from the AMS Input File. The ASMP(n) and ASMH(n ) 
partitions of each ASM(n) and the BSMP(n) and BSMH(n) partitions of each 
BSM(n) are generated automatically, given the coefficient matrices for the analog 
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state model, and the sampling policy as defined by the parameters TSEC, IT, and 
STBL. 

The weighting matrices QCST(n), NCST(n), and RCST[n), for n = 1, 2, . . . , IT, 
for the discrete performance index are generated automatically, with all partitions 
involving c(m,n) and u c (m,n) set to zero, given the coefficient matrices for the 
analog state model, the weighting matrices for the analog performance index, and 
the sampling policy. 

Finally, each covariance matrix GWG[n) for the discrete process noise is 
generated automatically, with all partitions involving c(m, n) set to zero, given the 
coefficient matrices for the analog state model, the intensity matrix for the analog 
process noise, and the sampling policy. 


Table C.l Format for the AMS Input File. 


Parameter 

Type 

Range 

Format 

m 

Integer 

>2 

(2113, 3D 13.5, L13) 

NTTRMX 

Integer 

>0 


TOL 

Real 

>0 


COST 

Real 

>0 


STEPMX 

Real 

>0 


HESFIG 

Logical 

— 


IXA 

Integer 

>1 

(813) 

IXC 

Integer 

>0 


IU1 

Integer 

>0 


IU2 

Integer 

>0 


ejc 

Integer 

>0 


IWA 

Integer 

>1 


IT 

Integer 

>2 


MM 

Integer 

>1 


TSEC 

Real 

>0 

(D13.5) 


The format for the AMS Input File is given in Tables A.l and A.2. The 
parameters in these tables axe read in the given order, using the indicated Fortran 
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formats. All matrices are read by rows, with each row starting on a new line. 
The elements of each of the vectors HESFAC and HESS are read consecutively, six 
elements per line. 


Table C.2 Format for the AMS Input File Continued. 


Parameter 

Type 

Dimensions 

Format 

F 

Real 

IXA-by-IXA 

(6D13.5) 

GU 

Real 

IXA-by-IUA 

(6D13.5) 

GW 

Real 

IXA-by-IWA 

(6D13.5) 

WA 

Real 

IWA-by-IWA 

(6D13.5) 

QA 

Real 

IXA-by-IXA 

(6D13.5) 

BA 

Real 

IUA-by-RIA 

(6D13.5) 

ASMC{ 1) 

Real 

IXC-by-IX 

(6D13.5) 

: 


: 

: 

ASMC (TT) 

Real 

IXC-by-IX 

(6D13.5) 

BSMC[ 1) 

Real 

IXC-by-lUC 

(6D13.5) 

1 

: 

\ 

• 

BSMC{TT) 

Real 

IXC-by-IUC 

(6D13.5) 

STBL 

Integer 

TT-by-IUl 

(5012) 

ALPHA 

Integer 

TT-by-MM 

(5012) 

FGM{ 1) 

Real 

IU -by- IX 

(6D13.5) 

• 

| 

; 

: 

FGM(TT) 

Real 

IU -by -IX 

(6D13.5) 

NOGBDF{ 1) 

Integer 

IU-by-IX 

(5012) 

; 

\ 

\ 

l 

NOGRDF(TT) 

Integer 

IU-by-IX 

(5012) 

HESFAC 

Real 

N *-by-l 

(6D13.5) 

HESS 

Real 

(iV*(JV— l))-by-l* 

(6D13.5) 


Column 3 of Table A.l lists the restrictions on the dimension parameters. The 
* N = IU*IX*MM. 
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AMS Main Program uses these dimensions to automatically allocate storage space 
for all parameters and work space for all calculations in a single vector Z . The 
vector Z is currently dimensioned at 20000 elements. This dimension of will have 
to be increased to accommodate problems with dimensions substantially larger than 
those of the example design problems of Chapters 5 and 6. 

The printout from the input phase of execution consists of a simple echo of most 
of the data read from the AMS Input File. On the AMS Output File at the end of 
this appendix, this printout starts on page 1. 

§C.3 Output Phase of Execution. The sole purpose of the output phase of 
execution is to save the final values for the feedback gains and the approximate 
Hessian matrix so that they can be used as the initial guess for these variables 
in a subsequent run. During the output phase, the final values for FGM(r), for 
r = 1 , 2, . . . , MM, and for HESFAC and HESS are written to the AMS Save File. 
The format for this file is given in Table A. 3. All matrices are written by rows, with 
each row starting on a new line. The elements of each of the vectors HESFAC and 
HESS are written consecutively, six elements per line. 


Table C.3 Format for the AMS Save File. 


Parameter 

Type 

Dimensions 

Format 

FGM{ 1) 

Real 

IU -by -IX 

(1P6D13.5) 

: 

: 


: 

FGM(IT) 

Real 

IU -by -IX 

(1P6D13.5) 

HESFAC 

Real 

N*- by-1 

(1P6D13.5) 

HESS 

Real 

(JV* (JV — l))-by-l* 

(1P6D13.5) 


A copy of the AMS Save File from the example AMS run discussed above is 
included at the end of this appendix. 

* N = IU*IX*MM. 
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8888 



OO-IO 


88888080 
♦ ♦♦♦♦♦♦♦ 
QQQQQQQQ 


8888 88888888888 



+ ♦ + ♦ ♦ 1 1 + 

QQQQQQQQ 


0 ? 

:> 

D Q Q Q Q 

mo 


5 cn 

5 O 0 v c 


cn c 

5 in 

55 vOc 

, ^ ^ 

O' C 

1 H 

5 0 m 0 C 


<N c 

5 

DOfflOC 

► O' O' 


OOOOONQH 


OOHOOtCKO 



OOOO OOOOOOOOOOO 

88388338 8888888888 


2 8888838383838388888338888888888888888888888 

*H ♦ I ■*♦♦♦♦ I !+♦ + + + + ♦♦ + + + + ♦ + + ♦ + ♦ + + + + 

OOaaaOQOOgQQQOQQQOOgOOOOOOOQOOOOQQOQOOOOOO^ 


HOOOO^OHO»NOHOHOOOOOO«flOOOOOOOOOOOOOOOOOOOOOO 

(N I • 


8-.S88888 88 88888 38388 8 388 888888888 8888888888 888 

O I ♦♦♦♦♦ + + ♦♦♦♦♦ I ♦ I ♦ ♦ ♦ I ♦♦♦♦♦♦♦♦♦♦♦ + ♦♦♦♦♦♦♦♦♦♦♦•» 

O^gQQQQOOQOOQQQQOQOQOOOOOQQQQQOQQaOQOOOOOOQQQQ 


'fM 0 00 00 N 0 H 0 N 0 HO 0 ' > t 0 0 0 H 0 0 H 000 0 w 000 ^ 000 H 000 rt 0 00 H 
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8 8 8 8 8 



o o o o o 


8 8 8 8 8 

♦ ♦ ♦ ♦ ♦ 

Q Q Q Q Q 



o o o o o 


8 8 8 8 8 

♦ ♦ ♦ ♦ ♦ 

q q a o a 



o o o o o 


8 8 8 8 8 



88888888888888888888888888 

QQQQQOQQQQQQQQQQQQQQOQQQOQ 



OOOOOOOOOOOhO^OhOhOwOhohOh 

88888888888888888888888888 

♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦ 

QOOQQQQOOOQQQOQQQQQQOQQDQQ 



OOOHOOOHOOHOOOOOOOOOOOOOOO 


8 8 



o o 


8 8 



o o 


8 8 



o o 


a 

\D 

in 

H 

< 7 * 

<*> 


8888 



-*0000000 
^OOOOOOOhhhhhhhh 


OHOO 


hhmh 

oooo 

♦ ♦ I I 

OOOO 

o 

hNHO' 

a* ao tn <n 

our vo «-< 
HrtON 



Page 3 of Example AMS Input File 


C.4 Example AMS Input File 


165 


8 8 8 


q a a 



6 6 6 


8 8 8 


Q Q Q 



odd 


8 8 8 

♦ + ♦ 


Q Q Q 



odd 


5 8 8 
+ ♦ ♦ 
a a a 



*66 


858885 

♦ ♦ + ♦ ♦ i 

QQQOQQ 

drtoooiflHOHOH 

i 

whO^O 


888588 


OQQOQQ 



000^00 


ooooo 

ooooo 

ooooo 

rtOHOO 

OOOOO 

HHOOO 
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iZ 

-w 

3 

a. 

s 

O 

CO 

s 

*< 

a. 

E 

rt 

X 

W 


be 


8888 



OOHO 


8888 




o o o o 


QMQH 


O 

» 

Q 

O 

if) 

CN 

•H 

00 

fs 


8888 



HOOO 


8888 
♦ ♦ ♦ ♦ 
Q Q Q a 


o o o o 


8 


0 ^ 0 -* 

I 

8888 
♦ ♦ ♦ ♦ 


hqn 

O H O ^ 

O OO 

oooo 

♦ ♦ ♦ 

♦ ♦ ♦ ♦ 

o a a 

Q Q a Q 

if Q <T* 


n Q in 

onfim 

O' O — < 

QO»OH 

CM O «N 

OmOn 


O* NHNM 

oo in oo h ii 

II II If II It II o 
II rfu II h<nu< I II W 
xSxSDDOZHgW 
hhhhhhhmHZH 


►h fH oi tn 

B 


tu 


X 

M 

i 

8 


OnOh 


t-i r* co 


O M O *-» 


8888 


Q C 

i a 

2 

l Q Q 

<r i 

n 

I GO *H 


» If t 

2 

00 < 

n 

1 (N 


l 00 t 

3 

vD < 

5 

> 

Q 

) so < 

n 

n i 

3 

> 

G 

► 00 1 

3 


X 

b*i 

B 


0 <NQH 
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88 
♦ ♦ 
QQ 


88 
♦ ♦ 
q a 


o o 

O O 

88 

88 

Q O 

^ Q Q 

d o 

++ o 

88 

88 

Q d 

Q O 


\D < 


\D I 


«£> 


in i 


o o 

o o 

88 

88 

d d 

d d 


in < 


8888 
♦ ♦ ♦ ♦ 
q a a a 


o o 

o o 

88 

88 

d d 

d d 


83 

♦ i 

Q D 


8 


o o 

I «*• Q 

*r a 

V O 
O O 

vD 6 


o o o o 


o o 

o o 

8838 

O — * ■“! 

o o o 

88 

88 

Q Q Q Q 

a a a 

a o 

Q Q 


18: 

’ ID t 
» CO ( 


NOOO 


• <** 
O' O' 


• ^ 
0^ O' 


HOO 


m i 


OOHO 

O \0\D 

O 

O -H 

8888 

ohf' 

o o o 

88 

88 

♦ ♦ ♦ ♦ 
q a a a 

d Q Q 

O Q 

d d 


o o o o 

O <0 <0 

o o 

o o 

3888 

388 

88 

88 

Q Q Q Q 

QOQ 

d d 

d d 


o o 


X 

h-i 

B 


X 

B 


O' 


r-l f*> ** 


B 

SS 

2 




•H (N M «H <N n 


9 
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8 

♦ 

O 


88 
♦ ♦ 
Q Q 


88 
♦ ♦ 
a a 


88 

4- 4 

Q Q 


88 
♦ ♦ 
a o 


88 
a 9 


8 

+ 

Q 


o o 

o o 

O O 

O O 

o o 

88 

88 

88 

88 

88 
A 4 

4 4 

Q Q 

r* o o 

4 4 

a a 
r- Q Q 

♦ 4 

O Q 
l" Q Q 

a a 
r-o o 

▼ » 
D Q 
t "OQ 


o 

8 

♦ 

Q 


t0 < 


88 
4- 4 

Q Q 


88 
+ ♦ 
Q O 


10 


88 
4- 4 

a a 


10 < 


88 

♦ 4 

a a 


«H O 

88 
Q 9 


-2 

Urn 

-•-» 

3 

Q. 


O 

8 

4 

Q 


O O 

o o 

O O 

O O 

o o 

88 

88 

88 

88 

88 

4 4 

a a 
o o 

Q Q 
moo 

a a 
moo 

Q Q 
moo 

mo8 


c 

co 

< 

0) 

o. 

£ 

rS 

X 

Cd 

w. 

o 

ec 

bfi 

rt 

a. 


o 

8 

+ 

a 

o 

8 

♦ 

a 


8 

♦ 

a 


O O 

o o 

O O 

o o 

o o 

88 

88 

88 

88 
4 4 

?? 

♦ 4 

a a 
Q Q 

4 4 

a a 
4QQ 

4 4 

a a 
'fQQ 

4 T 

a a 

400 

a a 
400 


n 


o o 

o o 

o o 

oo 

o o 

88 

88 

88 

88 

88 

4 4 

a a 
o o 

O Q 
"50 

a a 
nOO 

a q 

poo O 

no 8 


O 

O 

O rH 

O ^ 

O H 

88 

88 

88 

88 

88 

4 4 

Q Q 

Q Q 

Q Q 

a a 

O Q 


tN 


O 

o o 

O O 

o o 

o o 

oo 

8 

88 

88 

88 

88 

88 

a 

Q Q 

Q O 

a a 

a a 

Q 9 


o o 


o o 


o o 


o o 


o o 


n m <-t ps vo «h rs 


.-t r* 


kl 


£ 

3 


S 


8 


1 .OOOOD+OO O . OOOOD+OO 


O.OOOOD+OO l.OOOOD+OO 
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-2 

*■» 

3 

Q. 

3 

o 

cn 

2 

< 

*5. 

£ 

rt 

X 

U 


p 

to 

rt 

o- 


88 
♦ ♦ 
Q O 


8.8 

Q D 


88 
♦ ♦ 
Q Q 


88 

4- ♦ 

QQ 


88 
♦ ♦ 
Q Q 


O * 

88 
♦ ♦ 
Q Q 


88 

Q o 


88 
♦ ♦ 
q a 


88 
♦ ♦ 
Q D 


O H 

88 
♦ ♦ 
a a 


o o 


o o 


o o 


o o 


o o 


<N 

«~l (N 

<*> 

*-4 <N 

+r 

<N 

m 

•H <N 

vO 

• H <N 

r- 



w 






w 


w 

u 


u 


y 


u 


g 


y 

X 


r 


£ 


£ 



£ 

CO 


CO 


w 


W 


CO 


w 

00 


CD 


CQ 


m 


CQ 


ffi 


O.OOOOD+OO O.OOOOD+OO 
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CO 




\D 


.2 

3 

Cl 

3 

O 

c n 

s 

< 


4) 

a. 


E 

fa 

x 


W 



8 

♦ 

O 


8 

♦ 

a 


& 

M W 


UP 

O t-t 

e« 

z S 
O H 
U 

__ lu 

IS 



o o 




z 

w 

A3 


H O 

< U) 

2 03 


W K 

IS 


6 u 

a 

z a 

M U 

88 
♦ ♦ 
a a 

<-> s 

ft' H 
W 



UOOOOOOO 

UOOOOOOO 


X 

i 

a 

w 

u 

Du 



W O 

S5 

Sg 

>-t Q 

a 

z — . 

HI 

' H 

zi 

O hi 
HI ' 

W i-l 

O H 

cb y 

J H 
ffl < W 


W 


ssS| 

34 


in 


<n 


<N 


5 


. 1297D+01 O.OOOOD+OO 3.9316D-01 O.OOOOD+OO O.OOOOD+OO O.OOOOD+OO -1.3483D+01 1.0708D+00 
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r—i O ^ O 

H H O ^ O 

o o o o o 

o o o o o 

ooooo 
hOhOO 
ooooo 
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ju 

u, 


3 

a. 


O 


c n 

5 ' 


8 


o a 


OOl/IH 


h ii it 

H X 3 
Hhh 



O 10 

*h a 

O H 

0 c 

8 0 

0 c 

8 S 

luluO 

O CN 

Q H 


fN tu II 


H II Sij _) ' 
ii h ii o a tu 
>JtON>JOtO< 
ZHOObluiJMI 

HUluXOKl 


88888888 
♦ ♦♦♦♦♦♦♦ 
oooaaaoa 


8888888 
♦♦♦♦♦♦♦ 
q a o q a a a 


oooooooo 


ooooooo 


88888888 
♦ ♦♦♦♦♦♦♦ 
00000000 


8888888 
♦♦♦♦♦♦♦ 
q a a a a a a 


oooooooo 

88888888 

aaaaaaaa 


oooooooo 


OOOOOOH 


18888 


tn ^ in < 

0 o o « 

1 I I ♦ + + ♦ 

o a a o a o a 

\Q t N (7* vO i 

OOfflffi 
MOOHI 

OfOl 1 ' 
O'lO'fnOHO 


88888888 

♦♦♦♦♦♦♦♦ 

OQQOQQQO 


OOOOOOOO 

88088888 

aaaaaaaa 

Q Q IO 1 

1 fN I 
r-4 | 

00 I 

00 <N -<0000 


ss 


S0888 



Q Q Q O Q O Q 
m ™ <n r- o r ~ ~ 
r* *h a» ^ < 

VO VD rH ( 

1 1 

88S8888 

a a a a a a a 

Q O tfl 



o O M -H o o o 


88888888 

♦♦♦♦++♦♦ 

aaaaaaaa 


OOHOOOOH 


08888888 

t ♦♦♦♦♦♦♦ 

oooooooo 

rs m 1 ----- 

<N I 


NHOOOOOO 


8888888 
♦♦♦♦♦♦+ 
a a a a a a a 



NHOOOOO 


88888888 
♦ ♦♦♦♦♦♦♦ 
OOOOOOOO 


8888888 
♦ ♦♦♦♦♦♦ 
a a a a a a a 


HOOOOOHO 


HOOOOOO 




fN 


X 

2 
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88888888 


♦ + + ♦ 


QQQOOOQQ 


oooooooo 


88888888 

QDQQQQQQ 


OOOOOOHO 


88888888 
♦ ♦♦♦♦♦♦♦ 
QQQQQQQQ 



88888888 

+♦♦+++♦♦ 

QQQQQQQQ 


OOOOOOOO 

88888888 



OOOOOOHO 


OOOOOO-IO 


HI *H <N 

O o o 


88888 


♦ ♦ 


QQQQQQQQ 
V0 <N vO 1 
O O CD O' 
MflOHi 

o cd i 

O'iB'J'i’iOhOO 


n h in 
O O O 


88888 


♦ ♦ 


QQQQQQQQ 
\D \jD fN O' iD f 
O O CD O' I 
p- in O -I ( 

O oo »* i 

ouo^nOHOO 


ro — t <n 

O O O 


88888 


QQQQQQQQ 
ID iD r\j CP vO <“ 
OOOOOM 
MrtOHI 

O 00 ^ < 

& ko <n ohqo 


8 


^(N^fNQOOO 

oooooooo 

• I I I 


S <N CM 

o o o 


8888 

♦ ♦ ♦ ♦ 


S8S 


88888 
i ♦ ♦ ♦ ♦ 


r 

1 QQQQQQQQ 

1 QQQQQQQQ 

1 QQQQQQQQ 


i IflMNPOl 

O n o r. 

i in <n (N o < 

j o o c 

in <n <n r* o i 

0 o o o 

(") 

i r 

5 Q O ^ 

► r* »h O' < 

j 0 o c 

r* -< <t> <r i 

5 0 v O 

(*] 

► vO ^ H H 1 


► v0 yf) fH ( 

5 Q O c 

vfivfiHH! 

5000 

<5 

i n id i/i cn i 

5 o o c 

► tn in <n i 

D O O C 

ro vo in ni i 

jOOO 


C^O^nHOOO 

I I 

88888888 
♦ ♦ • ♦ ♦ ♦ ♦ ♦ 
QQQQQQQQ 

tfQQini 

> 04 ( 


^ndOOO 


88388888 
♦ ♦ » + + + + + 
QQQQQQQQ 


0»i0^nHOOO 

I I 

88888888 

QQQQQQQQ 
<f QQlO 

<N I 


OONHOOOO 


OOnirHOOOO 


OONHOOOO 


88888888 
♦ ♦♦♦♦♦♦♦ 
QQQQQQQQ 


88888888 
♦ ♦♦♦♦♦♦♦ 
QQQQQQQQ 


88888888 

♦♦♦♦♦♦♦+ 

QQQQQQQQ 


OOHOOOOH 


O O HO O O o 


8888888 


♦ ♦ ♦ 4* ♦ 


88888888 


c 

OQQQQQQQ 

QQQQQQQQ 

1 QQQQQQQQ 



(n in < 

£) Q Q O Q Q C 

) <N lO < 

T O O O Q o o 

o 

^YYVVvvV 

<N ( 

5 Y Y Y Y Y 5 

1 <N < 

5 Y Y Y Y Y V 

o 

•^vvvvVvv 

rH < 

5 Y Y Y Y V C 

> fH ( 

5555555 

0 

(OOOOOOOO 

00 < 

Soooooc 

1 CO ( 

DOOOOOO 


NHOOOOOO 


HHOOOOOO 


HHOOOOOO 


88888888 
♦ ♦♦♦♦♦♦♦ 
QQQQQQQQ 


88888888 
♦ ♦♦♦♦♦♦♦ 
QQQQQQQQ 


88888888 

♦+♦♦♦+♦♦ 

QQQQQQQQ 


HOOOOOOO 


HOOOOOOO 


HOOOOOOO 



eHfMfn^m^c^co 


«-f(Nm^*mtnf^oo 



ro 




m 




w 


W 


r 


£ 


£ 
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88888888 



66666666 


88888888 


♦ ♦♦♦♦♦♦♦ 

q a a a a a a a 



000000-40 


<nH(vOOOOO 

oooooooo 

I I !♦♦♦♦♦ 

QOQQQQQQ 

OOCO'OOOO 

MOOHQQQQ 

o<r®<roooo 

0 »v 0 5 f fOOHOO 

i i 

^(si'fNOOOO 

OOOOOOOO 

» I I I ♦ ♦ ♦ ♦ 

QQQQQQQQ 

tn<Nrsr^OQQQO 

C^*HO'^QQOQ 

^^hhOOOO 

r>sX)tO<NOOOO 


D^Tj'fOHOOO 


88S88888 
+ + !♦ + + + ♦ 


QQQOQQQQ 



OONHOOOO 


88888888 


++++♦+♦+ 

QQQQQQQQ 



oo^oooo*-< 


S8888888 


■ ♦♦+♦+♦+ 
QQQQQQQQ 



NHOOOOOO 


88888888 

♦♦+++♦♦♦ 


QQQQQQQQ 



HOOOOOOO 


88888888 



oooooooo 


88888888 


♦ ♦♦♦♦♦♦♦ 
QQQQQQQQ 



OOOOOOHO 


nHfMOOOOO 

OOOOOOOO 

I » »♦♦♦♦♦ 

QQQQQQQQ 

^ii)(N0'v0OOOO 

OOfiDO'OOOO 

MnOHQOOO 

0^5^0000 

O'vD^nOHOO 

i i 

S fN^INOOOO 

ooooooo 

» I I I ♦ + + + 

QQQQQQQQ 

in<NCNr^OOOOO 

r^*-4(7wOOOO 

if)»flHHngnQ 

r)*£in<NOOOO 




88388888 

♦ ♦ i ♦ ♦ ♦ ♦ ♦ 


QQQQQQQQ 



OONHOOOO 


88888888 


QQQQQQQQ 



OOHOOOOH 


08888888 

I ♦♦♦♦♦♦♦ 


QQQQQQQQ 



NHOOOOOO 


88888888 
♦ ♦♦♦♦♦♦♦ 



HOOOOOOO 


88888888 


♦ ♦♦♦♦♦♦♦ 



OOOOOOOO 


88888888 
♦ ♦♦♦♦♦♦♦ 



OOOOOOHO 


rnr-trvnnnnn 

OOOOOOOO 

» 1 »♦♦♦♦♦ 

QQQQQQQQ 
v^vDcnOnvDQOOO 
OOcoo'OOOO 
MnOHOOQO 
O^O^OOOO 

a»tD^<*)OHOO 

i 1 

S0S08888 

• » 1 1 ♦ ♦ ♦ ♦ 

QQQQQQQQ 
tn cn <n r* o 

h H (> T 
^ U) H H 
fO ® l/> 


o*vo^whooo 



♦ ♦ !♦ + + ♦♦ 


QQQQQQQQ 



OOMHOOOO 


88888888 


♦♦♦♦++♦♦ 

QQQQQQQQ 



OOhOOOOh 


S8888888 


1 ♦♦♦ + ♦♦♦ 
QQQQQQQQ 



NHOOOOOO 


88888888 
♦ ♦♦♦♦♦♦♦ 



HOOOOOOO 





* 


tn 


^ *h 01 ro in vd r* ® 


rH<NPO^*l/)vOr^® 


^ fH c*n in vD r- ® 
® 


x 

$ 
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2 


£ 

2 
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88888888 


QQQQQQQQ 


OOOOOOOH 


88888888 

++++++♦♦ 

00000000 


OOOOOOHO 


88888888 


♦+♦♦++♦+ 

aQQQQQQQ 



OOOOOOOH 


88888888 


♦ ♦♦♦♦♦♦♦ 



oooooooo 


88888888 


+++♦+♦++ 

QQQQQOQQ 



OOOOOOOH 


88888888 

♦♦♦♦♦♦♦♦ 


QQQQQOQQ 



OOOOOOOO 


888 


Q Q Q 



odd 


nwMQQOOO 

oooooooo 

I | I+ + + + + 

QQQQQOQQ 
\C n O' id r 
OO ®^ 1 
mtiOhi 

OnO^ noooo 


"hhOOOOO 

oooooooo 

I I !+ + ♦♦♦ 

QQQQQOQQ 

ijNff"flOOOO 

OOOOW'OOOO 

MnOHOftfift 

Of fi^OuOO 
o<iOf nOHOO 

i i 


HIHfNOOOOO 

oooooooo 

I I !+♦ + ♦ + 

QQQQQOQQ 

(fvOf'lO'vDOOOQ 

OOffla'OOOQ 

moohoooO 

Of «fOOOO 

ffnof moooo 


I I 

88888888 

QQQQQOQQ 



OOOOOOOO 


hwdoooOO 

OOOOOOOO 

I I !♦ + ♦♦ + 

QQQQQQQQ 
rnoNouBoooo 
OOfflO'OOOO 
MnOHOfiofi 
Of fflfOOOO 

9M0f noooo 
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88888888 


♦ ♦♦♦♦♦♦♦ 
QQQQQQQQ 



OOOOOOOO 


m *h <n 

000 

1 I I 
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O' vf> V 
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OOOOOOOO 
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QQQQQQQQ 

NNrooooo 
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vO'OHHnpOQ 
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Cnof OHOOO 


88888888 
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OOOOOOOO 


88888888 
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OOOOOOOO 


888 


Q Q Q 



odd 
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<n 
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f 


Z 

to 
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i 


z 
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88888 
♦ ♦♦♦♦ 
a a o o o 


88888888 
♦ ♦♦♦♦♦♦♦ 
00000000 


88888888 
♦ ♦♦♦♦♦♦♦ 
ooooaaao 


888888 
♦♦♦++♦ 
Q Q Q Q Q O 


O O O O 


oooooooo 


OOOOOOOH 


o o o o o o 


88888 
♦ ♦ ♦ ♦ ♦ 
o o o o o 


88888888 
♦ ♦♦♦♦♦♦♦ 
00000000 


88888888 
♦ ♦♦♦♦♦♦♦ 
Q QQ Q O O Q Q 


888888 
♦ ♦♦♦ + ♦ 
Q Q Q Q Q O 


o o o o o 


oooooooo 
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